Showing 1–50 of 391 results for author: Mei, S

Active Galaxy Science with the Line Emission Mapper: The Case for High-Resolution Soft X-ray Spectroscopy

Authors: Kimberly A. Weaver, Jenna M. Cann, Ryan W. Pfeifle, Malgorzata Sobolewska, Ciro Pinto, Mojegan Azadi, Delphine Porquet, Priyanka Chakraborty, Daniele Rogantini, Gerrit Schellenberger, Ryan Tanner, Simona Mei, Akos Bogdan, Dustin Nguyen

Abstract: This white paper discusses the breadth of science related to active galactic nuclei (AGN) and associated phenomena to be enabled by a mission with microcalorimeter energy resolution in the soft X-ray band, a large collecting area, and wide-field imaging. Such a mission, the Line Emission Mapper (LEM), has been proposed to NASA's 2023 Astrophysics Probe Explorer call. While the science pillars of t… ▽ More This white paper discusses the breadth of science related to active galactic nuclei (AGN) and associated phenomena to be enabled by a mission with microcalorimeter energy resolution in the soft X-ray band, a large collecting area, and wide-field imaging. Such a mission, the Line Emission Mapper (LEM), has been proposed to NASA's 2023 Astrophysics Probe Explorer call. While the science pillars of the PI-led part of the mission focus on galaxy evolution, the PI-led LEM All-Sky Survey (LASS) and General Observer/Investigator opportunities will enable vital discoveries for AGN science in the critical soft X-ray band. △ Less

Submitted 26 June, 2024; originally announced June 2024.

Comments: 22 pages, 16 figures

Euclid preparation. Sensitivity to non-standard particle dark matter model

Authors: Euclid Collaboration, J. Lesgourgues, J. Schwagereit, J. Bucko, G. Parimbelli, S. K. Giri, F. Hervas-Peters, A. Schneider, M. Archidiacono, F. Pace, Z. Sakr, A. Amara, L. Amendola, S. Andreon, N. Auricchio, H. Aussel, C. Baccigalupi, M. Baldi, S. Bardelli, R. Bender, C. Bodendorf, D. Bonino, E. Branchini, M. Brescia, J. Brinchmann , et al. (227 additional authors not shown)

Abstract: The Euclid mission of the European Space Agency will provide weak gravitational lensing and galaxy clustering surveys that can be used to constrain the standard cosmological model and its extensions, with an opportunity to test the properties of dark matter beyond the minimal cold dark matter paradigm. We present forecasts from the combination of these surveys on the parameters describing four int… ▽ More The Euclid mission of the European Space Agency will provide weak gravitational lensing and galaxy clustering surveys that can be used to constrain the standard cosmological model and its extensions, with an opportunity to test the properties of dark matter beyond the minimal cold dark matter paradigm. We present forecasts from the combination of these surveys on the parameters describing four interesting and representative non-minimal dark matter models: a mixture of cold and warm dark matter relics; unstable dark matter decaying either into massless or massive relics; and dark matter experiencing feeble interactions with relativistic relics. We model these scenarios at the level of the non-linear matter power spectrum using emulators trained on dedicated N-body simulations. We use a mock Euclid likelihood to fit mock data and infer error bars on dark matter parameters marginalised over other parameters. We find that the Euclid photometric probe (alone or in combination with CMB data from the Planck satellite) will be sensitive to the effect of each of the four dark matter models considered here. The improvement will be particularly spectacular for decaying and interacting dark matter models. With Euclid, the bounds on some dark matter parameters can improve by up to two orders of magnitude compared to current limits. We discuss the dependence of predicted uncertainties on different assumptions: inclusion of photometric galaxy clustering data, minimum angular scale taken into account, modelling of baryonic feedback effects. We conclude that the Euclid mission will be able to measure quantities related to the dark sector of particle physics with unprecedented sensitivity. This will provide important information for model building in high-energy physics. Any hint of a deviation from the minimal cold dark matter paradigm would have profound implications for cosmology and particle physics. △ Less

Submitted 26 June, 2024; originally announced June 2024.

Comments: 31 pages, 21 figures

Report number: TTK-24-26

FoodSky: A Food-oriented Large Language Model that Passes the Chef and Dietetic Examination

Authors: Pengfei Zhou, Weiqing Min, Chaoran Fu, Ying **, Mingyu Huang, Xiangyang Li, Shuhuan Mei, Shuqiang Jiang

Abstract: Food is foundational to human life, serving not only as a source of nourishment but also as a cornerstone of cultural identity and social interaction. As the complexity of global dietary needs and preferences grows, food intelligence is needed to enable food perception and reasoning for various tasks, ranging from recipe generation and dietary recommendation to diet-disease correlation discovery a… ▽ More Food is foundational to human life, serving not only as a source of nourishment but also as a cornerstone of cultural identity and social interaction. As the complexity of global dietary needs and preferences grows, food intelligence is needed to enable food perception and reasoning for various tasks, ranging from recipe generation and dietary recommendation to diet-disease correlation discovery and understanding. Towards this goal, for powerful capabilities across various domains and tasks in Large Language Models (LLMs), we introduce Food-oriented LLM FoodSky to comprehend food data through perception and reasoning. Considering the complexity and typicality of Chinese cuisine, we first construct one comprehensive Chinese food corpus FoodEarth from various authoritative sources, which can be leveraged by FoodSky to achieve deep understanding of food-related data. We then propose Topic-based Selective State Space Model (TS3M) and the Hierarchical Topic Retrieval Augmented Generation (HTRAG) mechanism to enhance FoodSky in capturing fine-grained food semantics and generating context-aware food-relevant text, respectively. Our extensive evaluations demonstrate that FoodSky significantly outperforms general-purpose LLMs in both chef and dietetic examinations, with an accuracy of 67.2% and 66.4% on the Chinese National Chef Exam and the National Dietetic Exam, respectively. FoodSky not only promises to enhance culinary creativity and promote healthier eating patterns, but also sets a new standard for domain-specific LLMs that address complex real-world issues in the food domain. An online demonstration of FoodSky is available at http://222.92.101.211:8200. △ Less

Submitted 10 June, 2024; originally announced June 2024.

Comments: 32 pages, 19 figures

Large Stepsize Gradient Descent for Non-Homogeneous Two-Layer Networks: Margin Improvement and Fast Optimization

Authors: Yuhang Cai, **gfeng Wu, Song Mei, Michael Lindsey, Peter L. Bartlett

Abstract: The typical training of neural networks using large stepsize gradient descent (GD) under the logistic loss often involves two distinct phases, where the empirical risk oscillates in the first phase but decreases monotonically in the second phase. We investigate this phenomenon in two-layer networks that satisfy a near-homogeneity condition. We show that the second phase begins once the empirical r… ▽ More The typical training of neural networks using large stepsize gradient descent (GD) under the logistic loss often involves two distinct phases, where the empirical risk oscillates in the first phase but decreases monotonically in the second phase. We investigate this phenomenon in two-layer networks that satisfy a near-homogeneity condition. We show that the second phase begins once the empirical risk falls below a certain threshold, dependent on the stepsize. Additionally, we show that the normalized margin grows nearly monotonically in the second phase, demonstrating an implicit bias of GD in training non-homogeneous predictors. If the dataset is linearly separable and the derivative of the activation function is bounded away from zero, we show that the average empirical risk decreases, implying that the first phase must stop in finite steps. Finally, we demonstrate that by choosing a suitably large stepsize, GD that undergoes this phase transition is more efficient than GD that monotonically decreases the risk. Our analysis applies to networks of any width, beyond the well-known neural tangent kernel and mean-field regimes. △ Less

Submitted 26 June, 2024; v1 submitted 12 June, 2024; originally announced June 2024.

Comments: Clarify our results on sigmoid neural networks

On the Influence of Smoothness Constraints in Computed Tomography Motion Compensation

Authors: Mareike Thies, Fabian Wagner, Noah Maul, Siyuan Mei, Mingxuan Gu, Laura Pfaff, Nastassia Vysotskaya, Haijun Yu, Andreas Maier

Abstract: Computed tomography (CT) relies on precise patient immobilization during image acquisition. Nevertheless, motion artifacts in the reconstructed images can persist. Motion compensation methods aim to correct such artifacts post-acquisition, often incorporating temporal smoothness constraints on the estimated motion patterns. This study analyzes the influence of a spline-based motion model within an… ▽ More Computed tomography (CT) relies on precise patient immobilization during image acquisition. Nevertheless, motion artifacts in the reconstructed images can persist. Motion compensation methods aim to correct such artifacts post-acquisition, often incorporating temporal smoothness constraints on the estimated motion patterns. This study analyzes the influence of a spline-based motion model within an existing rigid motion compensation algorithm for cone-beam CT on the recoverable motion frequencies. Results demonstrate that the choice of motion model crucially influences recoverable frequencies. The optimization-based motion compensation algorithm is able to accurately fit the spline nodes for frequencies almost up to the node-dependent theoretical limit according to the Nyquist-Shannon theorem. Notably, a higher node count does not compromise reconstruction performance for slow motion patterns, but can extend the range of recoverable high frequencies for the investigated algorithm. Eventually, the optimal motion model is dependent on the imaged anatomy, clinical use case, and scanning protocol and should be tailored carefully to the expected motion frequency spectrum to ensure accurate motion compensation. △ Less

Submitted 29 May, 2024; originally announced May 2024.

Euclid preparation. Observational expectations for redshift z<7 active galactic nuclei in the Euclid Wide and Deep surveys

Authors: Euclid Collaboration, M. Selwood, S. Fotopoulou, M. N. Bremer, L. Bisigello, H. Landt, E. Bañados, G. Zamorani, F. Shankar, D. Stern, E. Lusso, L. Spinoglio, V. Allevato, F. Ricci, A. Feltre, F. Mannucci, M. Salvato, R. A. A. Bowler, M. Mignoli, D. Vergani, F. La Franca, A. Amara, S. Andreon, N. Auricchio, M. Baldi , et al. (238 additional authors not shown)

Abstract: We forecast the expected population of active galactic nuclei (AGN) observable in the Euclid Wide Survey (EWS) and Euclid Deep Survey (EDS). Starting from an X-ray luminosity function (XLF) we generate volume-limited samples of the AGN expected in the survey footprints. Each AGN is assigned an SED appropriate for its X-ray luminosity and redshift, with perturbations sampled from empirical distribu… ▽ More We forecast the expected population of active galactic nuclei (AGN) observable in the Euclid Wide Survey (EWS) and Euclid Deep Survey (EDS). Starting from an X-ray luminosity function (XLF) we generate volume-limited samples of the AGN expected in the survey footprints. Each AGN is assigned an SED appropriate for its X-ray luminosity and redshift, with perturbations sampled from empirical distributions. The photometric detectability of each AGN is assessed via mock observation of the assigned SED. We estimate 40 million AGN will be detectable in at least one band in the EWS and 0.24 million in the EDS, corresponding to surface densities of 2.8$\times$10$^{3}$ deg$^{-2}$ and 4.7$\times$10$^{3}$ deg$^{-2}$. Employing colour selection criteria on our simulated data we select a sample of 4.8$\times$10$^{6}$ (331 deg$^{-2}$) AGN in the EWS and 1.7$\times$10$^{4}$ (346 deg$^{-2}$) in the EDS, amounting to 10% and 8% of the AGN detectable in the EWS and EDS. Including ancillary Rubin/LSST bands improves the completeness and purity of AGN selection. These data roughly double the total number of selected AGN to comprise 21% and 15% of the detectable AGN in the EWS and EDS. The total expected sample of colour-selected AGN contains 6.0$\times$10$^{6}$ (74%) unobscured AGN and 2.1$\times$10$^{6}$ (26%) obscured AGN, covering $0.02 \leq z \lesssim 5.2$ and $43 \leq \log_{10} (L_{bol} / erg s^{-1}) \leq 47$. With this simple colour selection, expected surface densities are already comparable to the yield of modern X-ray and mid-infrared surveys of similar area. The relative uncertainty on our expectation for detectable AGN is 6.7% for the EWS and 12.5% for the EDS, driven by the uncertainty of the XLF. △ Less

Submitted 28 May, 2024; originally announced May 2024.

Comments: 36 pages, 21 figures, submitted to A&A

Euclid preparation. Detecting globular clusters in the Euclid survey

Authors: Euclid Collaboration, K. Voggel, A. Lançon, T. Saifollahi, S. S. Larsen, M. Cantiello, M. Rejkuba, J. -C. Cuillandre, P. Hudelot, A. A. Nucita, M. Urbano, E. Romelli, M. A. Raj, M. Schirmer, C. Tortora, Abdurro'uf, F. Annibali, M. Baes, P. Boldrini, R. Cabanac, D. Carollo, C. J. Conselice, P. -A. Duc, A. M. N. Ferguson, L. K. Hunt , et al. (247 additional authors not shown)

Abstract: Extragalactic globular clusters (EGCs) are an abundant and powerful tracer of galaxy dynamics and formation, and their own formation and evolution is also a matter of extensive debate. The compact nature of globular clusters means that they are hard to spatially resolve and thus study outside the Local Group. In this work we have examined how well EGCs will be detectable in images from the Euclid… ▽ More Extragalactic globular clusters (EGCs) are an abundant and powerful tracer of galaxy dynamics and formation, and their own formation and evolution is also a matter of extensive debate. The compact nature of globular clusters means that they are hard to spatially resolve and thus study outside the Local Group. In this work we have examined how well EGCs will be detectable in images from the Euclid telescope, using both simulated pre-launch images and the first early-release observations of the Fornax galaxy cluster. The Euclid Wide Survey will provide high-spatial resolution VIS imaging in the broad IE band as well as near-infrared photometry (YE, JE, and HE). We estimate that the galaxies within 100 Mpc in the footprint of the Euclid survey host around 830 000 EGCs of which about 350 000 are within the survey's detection limits. For about half of these EGCs, three infrared colours will be available as well. For any galaxy within 50Mpc the brighter half of its GC luminosity function will be detectable by the Euclid Wide Survey. The detectability of EGCs is mainly driven by the residual surface brightness of their host galaxy. We find that an automated machine-learning EGC-classification method based on real Euclid data of the Fornax galaxy cluster provides an efficient method to generate high purity and high completeness GC candidate catalogues. We confirm that EGCs are spatially resolved compared to pure point sources in VIS images of Fornax. Our analysis of both simulated and first on-sky data show that Euclid will increase the number of GCs accessible with high-resolution imaging substantially compared to previous surveys, and will permit the study of GCs in the outskirts of their hosts. Euclid is unique in enabling systematic studies of EGCs in a spatially unbiased and homogeneous manner and is primed to improve our understanding of many understudied aspects of GC astrophysics. △ Less

Submitted 29 May, 2024; v1 submitted 22 May, 2024; originally announced May 2024.

Comments: Submitted to A&A

Euclid: ERO -- NISP-only sources and the search for luminous $z=6-8$ galaxies

Authors: J. R. Weaver, S. Taamoli, C. J. R. McPartland, L. Zalesky, N. Allen, S. Toft, D. B. Sanders, H. Atek, R. A. A. Bowler, D. Stern, C. J. Conselice, B. Mobasher, I. Szapudi, P. R. M. Eisenhardt, G. Murphree, I. Valdes, K. Ito, S. Belladitta, P. A. Oesch, S. Serjeant, D. J. Mortlock, N. A. Hatch, M. Kluge, B. Milvang-Jensen, G. Rodighiero , et al. (163 additional authors not shown)

Abstract: This paper presents a search for high redshift galaxies from the Euclid Early Release Observations program "Magnifying Lens." The 1.5 deg$^2$ area covered by the twin Abell lensing cluster fields is comparable in size to the few other deep near-infrared surveys such as COSMOS, and so provides an opportunity to significantly increase known samples of rare UV-bright galaxies at $z\approx6-8$ (… ▽ More This paper presents a search for high redshift galaxies from the Euclid Early Release Observations program "Magnifying Lens." The 1.5 deg$^2$ area covered by the twin Abell lensing cluster fields is comparable in size to the few other deep near-infrared surveys such as COSMOS, and so provides an opportunity to significantly increase known samples of rare UV-bright galaxies at $z\approx6-8$ ($M_{\rm UV}\lesssim-22$). Beyond their still uncertain role in reionisation, these UV-bright galaxies are ideal laboratories from which to study galaxy formation and constrain the bright-end of the UV luminosity function. Of the 501994 sources detected from a combined $Y_{\rm E}$, $J_{\rm E}$, and $H_{\rm E}$ NISP detection image, 168 do not have any appreciable VIS/$I_{\rm E}$ flux. These objects span a range in spectral colours, separated into two classes: 139 extremely red sources; and 29 Lyman-break galaxy candidates. Best-fit redshifts and spectral templates suggest the former is composed of both $z\gtrsim5$ dusty star-forming galaxies and $z\approx1-3$ quiescent systems. The latter is composed of more homogeneous Lyman break galaxies at $z\approx6-8$. In both cases, contamination by L- and T-type dwarfs cannot be ruled out with Euclid images alone. Additional contamination from instrumental persistence is investigated using a novel time series analysis. This work lays the foundation for future searches within the Euclid Deep Fields, where thousands more $z\gtrsim6$ Lyman break systems and extremely red sources will be identified. △ Less

Submitted 22 May, 2024; originally announced May 2024.

Comments: 22 pages, 13 figures, paper submitted as part of the A&A special issue `Euclid on Sky', which contains Euclid key reference papers and first results from the Euclid Early Release Observations

Euclid: Early Release Observations -- A preview of the Euclid era through a galaxy cluster magnifying lens

Authors: H. Atek, R. Gavazzi, J. R. Weaver, J. M. Diego, T. Schrabback, N. A. Hatch, N. Aghanim, H. Dole, W. G. Hartley, S. Taamoli, G. Congedo, Y. Jimenez-Teja, J. -C. Cuillandre, E. Bañados, S. Belladitta, R. A. A. Bowler, M. Franco, M. Jauzac, G. Mahler, J. Richard, P. -F. Rocci, S. Serjeant, S. Toft, D. Abriola, P. Bergamini , et al. (178 additional authors not shown)

Abstract: We present the first analysis of the Euclid Early Release Observations (ERO) program that targets fields around two lensing clusters, Abell 2390 and Abell 2764. We use VIS and NISP imaging to produce photometric catalogs for a total of $\sim 500\,000$ objects. The imaging data reach a $5\,σ$ typical depth in the range 25.1-25.4 AB in the NISP bands, and 27.1-27.3 AB in the VIS band. Using the Lyma… ▽ More We present the first analysis of the Euclid Early Release Observations (ERO) program that targets fields around two lensing clusters, Abell 2390 and Abell 2764. We use VIS and NISP imaging to produce photometric catalogs for a total of $\sim 500\,000$ objects. The imaging data reach a $5\,σ$ typical depth in the range 25.1-25.4 AB in the NISP bands, and 27.1-27.3 AB in the VIS band. Using the Lyman-break method in combination with photometric redshifts, we identify $30$ Lyman-break galaxy (LBG) candidates at $z>6$ and 139 extremely red sources (ERSs), most likely at lower redshift. The deeper VIS imaging compared to NISP means we can routinely identify high-redshift Lyman breaks of the order of $3$ magnitudes, which reduces contamination by brown dwarf stars and low-redshift galaxies. Spectroscopic follow-up campaigns of such bright sources will help constrain both the bright end of the ultraviolet galaxy luminosity function and the quasar luminosity function at $z>6$, and constrain the physical nature of these objects. Additionally, we have performed a combined strong lensing and weak lensing analysis of A2390, and demonstrate how Euclid will contribute to better constraining the virial mass of galaxy clusters. From these data, we also identify optical and near-infrared counterparts of known $z>0.6$ clusters, which exhibit strong lensing features, establishing the ability of Euclid to characterize high-redshift clusters. Finally, we provide a glimpse of Euclid's ability to map the intracluster light out to larger radii than current facilities, enabling a better understanding of the cluster assembly history and map** of the dark matter distribution. This initial dataset illustrates the diverse spectrum of legacy science that will be enabled by the Euclid survey. △ Less

Submitted 22 May, 2024; originally announced May 2024.

Comments: Paper submitted as part of the A&A special issue `Euclid on Sky', which contains Euclid key reference papers and first results from the Euclid Early Release Observations. 17 pages, 12 figures

Euclid: Early Release Observations -- The intracluster light and intracluster globular clusters of the Perseus cluster

Authors: M. Kluge, N. A. Hatch, M. Montes, J. B. Golden-Marx, A. H. Gonzalez, J. -C. Cuillandre, M. Bolzonella, A. Lançon, R. Laureijs, T. Saifollahi, M. Schirmer, C. Stone, A. Boselli, M. Cantiello, J. G. Sorce, F. R. Marleau, P. -A. Duc, E. Sola, M. Urbano, S. L. Ahad, Y. M. Bahé, S. P. Bamford, C. Bellhouse, F. Buitrago, P. Dimauro , et al. (163 additional authors not shown)

Abstract: We study the intracluster light (ICL) and intracluster globular clusters (ICGCs) in the nearby Perseus galaxy cluster using Euclid's EROs. By modelling the isophotal and iso-density contours, we map the distributions and properties of the ICL and ICGCs out to a radius of 600 kpc (~1/3 of the virial radius) from the brightest cluster galaxy (BCG). We find that the central 500 kpc of the Perseus clu… ▽ More We study the intracluster light (ICL) and intracluster globular clusters (ICGCs) in the nearby Perseus galaxy cluster using Euclid's EROs. By modelling the isophotal and iso-density contours, we map the distributions and properties of the ICL and ICGCs out to a radius of 600 kpc (~1/3 of the virial radius) from the brightest cluster galaxy (BCG). We find that the central 500 kpc of the Perseus cluster hosts 70000$\pm$2800 GCs and $1.6\times10^{12}$ L$_\odot$ of diffuse light from the BCG+ICL in the near-infrared H$_E$. This accounts for 37$\pm$6% of the cluster's total stellar luminosity within this radius. The ICL and ICGCs share a coherent spatial distribution, suggesting a common origin or that a common potential governs their distribution. Their contours on the largest scales (>200 kpc) are offset from the BCG's core westwards by 60 kpc towards several luminous cluster galaxies. This offset is opposite to the displacement observed in the gaseous intracluster medium. The radial surface brightness profile of the BCG+ICL is best described by a double Sérsic model, with 68$\pm$4% of the H$_E$ light in the extended, outer component. The transition between these components occurs at ~50 kpc, beyond which the isophotes become increasingly elliptical and off-centred. The radial ICGC number density profile closely follows the BCG+ICL profile only beyond this 50 kpc radius, where we find an average of 60 GCs per $10^9$ M$_\odot$ of diffuse stellar mass. The BCG+ICL colour becomes increasingly blue with radius, consistent with the stellar populations in the ICL having subsolar metallicities [Fe/H]~-0.6. The colour of the ICL, and the specific frequency and luminosity function of the ICGCs suggest that the ICL+ICGCs were tidally stripped from the outskirts of massive satellites with masses of a few $\times10^{10}$ M$_\odot$, with an increasing contribution from dwarf galaxies at large radii. △ Less

Submitted 22 May, 2024; originally announced May 2024.

Comments: Paper submitted as part of the A&A special issue `Euclid on Sky', which contains Euclid key reference papers and first results from the Euclid Early Release Observations. 24 pages, 17 figures, 5 tables. Submitted to A&A

Euclid: Early Release Observations -- Dwarf galaxies in the Perseus galaxy cluster

Authors: F. R. Marleau, J. -C. Cuillandre, M. Cantiello, D. Carollo, P. -A. Duc, R. Habas, L. K. Hunt, P. Jablonka, M. Mirabile, M. Mondelin, M. Poulain, T. Saifollahi, R. Sánchez-Janssen, E. Sola, M. Urbano, R. Zöller, M. Bolzonella, A. Lançon, R. Laureijs, O. Marchal, M. Schirmer, C. Stone, A. Boselli, A. Ferré-Mateu, N. A. Hatch , et al. (171 additional authors not shown)

Abstract: We make use of the unprecedented depth, spatial resolution, and field of view of the Euclid Early Release Observations of the Perseus galaxy cluster to detect and characterise the dwarf galaxy population in this massive system. The Euclid high resolution VIS and combined VIS+NIR colour images were visually inspected and dwarf galaxy candidates were identified. Their morphologies, the presence of n… ▽ More We make use of the unprecedented depth, spatial resolution, and field of view of the Euclid Early Release Observations of the Perseus galaxy cluster to detect and characterise the dwarf galaxy population in this massive system. The Euclid high resolution VIS and combined VIS+NIR colour images were visually inspected and dwarf galaxy candidates were identified. Their morphologies, the presence of nuclei, and their globular cluster (GC) richness were visually assessed, complementing an automatic detection of the GC candidates. Structural and photometric parameters, including Euclid filter colours, were extracted from 2-dimensional fitting. Based on this analysis, a total of 1100 dwarf candidates were found across the image, with 638 appearing to be new identifications. The majority (96%) are classified as dwarf ellipticals, 53% are nucleated, 26% are GC-rich, and 6% show disturbed morphologies. A relatively high fraction of galaxies, 8%, are categorised as ultra-diffuse galaxies. The majority of the dwarfs follow the expected scaling relations. Globally, the GC specific frequency, S_N, of the Perseus dwarfs is intermediate between those measured in the Virgo and Coma clusters. While the dwarfs with the largest GC counts are found throughout the Euclid field of view, those located around the east-west strip, where most of the brightest cluster members are found, exhibit larger S_N values, on average. The spatial distribution of the dwarfs, GCs, and intracluster light show a main iso-density/isophotal centre displaced to the west of the bright galaxy light distribution. The ERO imaging of the Perseus cluster demonstrates the unique capability of Euclid to concurrently detect and characterise large samples of dwarfs, their nuclei, and their GC systems, allowing us to construct a detailed picture of the formation and evolution of galaxies over a wide range of mass scales and environments. △ Less

Submitted 22 May, 2024; originally announced May 2024.

Comments: 44 pages, 24 figures, 5 tables, paper submitted to A&A as part of the A&A special issue `Euclid on Sky', which contains Euclid key reference papers and first results from the Euclid Early Release Observations

Euclid: Early Release Observations -- Overview of the Perseus cluster and analysis of its luminosity and stellar mass functions

Authors: J. -C. Cuillandre, M. Bolzonella, A. Boselli, F. R. Marleau, M. Mondelin, J. G. Sorce, C. Stone, F. Buitrago, Michele Cantiello, K. George, N. A. Hatch, L. Quilley, F. Mannucci, T. Saifollahi, R. Sánchez-Janssen, F. Tarsitano, C. Tortora, X. Xu, H. Bouy, S. Gwyn, M. Kluge, A. Lançon, R. Laureijs, M. Schirmer, Abdurro'uf , et al. (177 additional authors not shown)

Abstract: The Euclid ERO programme targeted the Perseus cluster of galaxies, gathering deep data in the central region of the cluster over 0.7 square degree, corresponding to approximately 0.25 r_200. The data set reaches a point-source depth of IE=28.0 (YE, JE, HE = 25.3) AB magnitudes at 5 sigma with a 0.16" and 0.48" FWHM, and a surface brightness limit of 30.1 (29.2) mag per square arcsec. The exception… ▽ More The Euclid ERO programme targeted the Perseus cluster of galaxies, gathering deep data in the central region of the cluster over 0.7 square degree, corresponding to approximately 0.25 r_200. The data set reaches a point-source depth of IE=28.0 (YE, JE, HE = 25.3) AB magnitudes at 5 sigma with a 0.16" and 0.48" FWHM, and a surface brightness limit of 30.1 (29.2) mag per square arcsec. The exceptional depth and spatial resolution of this wide-field multi-band data enable the simultaneous detection and characterisation of both bright and low surface brightness galaxies, along with their globular cluster systems, from the optical to the NIR. This study advances beyond previous analyses of the cluster and enables a range of scientific investigations summarised here. We derive the luminosity and stellar mass functions (LF and SMF) of the Perseus cluster in the Euclid IE band, thanks to supplementary u,g,r,i,z and Halpha data from the CFHT. We adopt a catalogue of 1100 dwarf galaxies, detailed in the corresponding ERO paper. We identify all other sources in the Euclid images and obtain accurate photometric measurements using AutoProf or AstroPhot for 138 bright cluster galaxies, and SourceExtractor for half a million compact sources. Cluster membership for the bright sample is determined by calculating photometric redshifts with Phosphoros. Our LF and SMF are the deepest recorded for the Perseus cluster, highlighting the groundbreaking capabilities of the Euclid telescope. Both the LF and SMF fit a Schechter plus Gaussian model. The LF features a dip at M(IE)=-19 and a faint-end slope of alpha_S = -1.2 to -1.3. The SMF displays a low-mass-end slope of alpha_S = -1.2 to -1.35. These observed slopes are flatter than those predicted for dark matter halos in cosmological simulations, offering significant insights for models of galaxy formation and evolution. △ Less

Submitted 22 May, 2024; originally announced May 2024.

Comments: Submitted to A&A, 44 pages, 35 figures, Part of the A&A special issue `Euclid on Sky', which contains Euclid key reference papers and first results from the Euclid Early Release Observations

Euclid: Early Release Observations -- Globular clusters in the Fornax galaxy cluster, from dwarf galaxies to the intracluster field

Authors: T. Saifollahi, K. Voggel, A. Lançon, Michele Cantiello, M. A. Raj, J. -C. Cuillandre, S. S. Larsen, F. R. Marleau, A. Venhola, M. Schirmer, D. Carollo, P. -A. Duc, A. M. N. Ferguson, L. K. Hunt, M. Kümmel, R. Laureijs, O. Marchal, A. A. Nucita, R. F. Peletier, M. Poulain, M. Rejkuba, R. Sánchez-Janssen, M. Urbano, Abdurro'uf, B. Altieri , et al. (174 additional authors not shown)

Abstract: We present an analysis of Euclid observations of a 0.5 deg$^2$ field in the central region of the Fornax galaxy cluster that were acquired during the performance verification phase. With these data, we investigate the potential of Euclid for identifying GCs at 20 Mpc, and validate the search methods using artificial GCs and known GCs within the field from the literature. Our analysis of artificial… ▽ More We present an analysis of Euclid observations of a 0.5 deg$^2$ field in the central region of the Fornax galaxy cluster that were acquired during the performance verification phase. With these data, we investigate the potential of Euclid for identifying GCs at 20 Mpc, and validate the search methods using artificial GCs and known GCs within the field from the literature. Our analysis of artificial GCs injected into the data shows that Euclid's data in $I_{\rm E}$ band is 80% complete at about $I_{\rm E} \sim 26.0$ mag ($M_{V\rm } \sim -5.0$ mag), and resolves GCs as small as $r_{\rm h} = 2.5$ pc. In the $I_{\rm E}$ band, we detect more than 95% of the known GCs from previous spectroscopic surveys and GC candidates of the ACS Fornax Cluster Survey, of which more than 80% are resolved. We identify more than 5000 new GC candidates within the field of view down to $I_{\rm E}$ mag, about 1.5 mag fainter than the typical GC luminosity function turn-over magnitude, and investigate their spatial distribution within the intracluster field. We then focus on the GC candidates around dwarf galaxies and investigate their numbers, stacked luminosity distribution and stacked radial distribution. While the overall GC properties are consistent with those in the literature, an interesting over-representation of relatively bright candidates is found within a small number of relatively GC-rich dwarf galaxies. Our work confirms the capabilities of Euclid data in detecting GCs and separating them from foreground and background contaminants at a distance of 20 Mpc, particularly for low-GC count systems such as dwarf galaxies. △ Less

Submitted 22 May, 2024; originally announced May 2024.

Comments: Paper submitted as part of the A&A special issue `Euclid on Sky', which contains Euclid key reference papers and first results from the Euclid Early Release Observations

Euclid: Early Release Observations -- Deep anatomy of nearby galaxies

Authors: L. K. Hunt, F. Annibali, J. -C. Cuillandre, A. M. N. Ferguson, P. Jablonka, S. S. Larsen, F. R. Marleau, E. Schinnerer, M. Schirmer, C. Stone, C. Tortora, T. Saifollahi, A. Lançon, M. Bolzonella, S. Gwyn, M. Kluge, R. Laureijs, D. Carollo, M. L. M. Collins, P. Dimauro, P. -A. Duc, D. Erkal, J. M. Howell, C. Nally, E. Saremi , et al. (174 additional authors not shown)

Abstract: Euclid is poised to make significant advances in the study of nearby galaxies in the local Universe. Here we present a first look at 6 galaxies observed for the Nearby Galaxy Showcase as part of the Euclid Early Release Observations acquired between August and November, 2023. These targets, 3 dwarf galaxies (HolmbergII, IC10, NGC6822) and 3 spirals (IC342, NGC2403, NGC6744), range in distance from… ▽ More Euclid is poised to make significant advances in the study of nearby galaxies in the local Universe. Here we present a first look at 6 galaxies observed for the Nearby Galaxy Showcase as part of the Euclid Early Release Observations acquired between August and November, 2023. These targets, 3 dwarf galaxies (HolmbergII, IC10, NGC6822) and 3 spirals (IC342, NGC2403, NGC6744), range in distance from about 0.5 Mpc to 8.8 Mpc. Our assessment of the surface brightness depths in the stacked Euclid images confirms previous estimates in 100 arcsec^2 regions of 1sigma=30.5 mag/arcsec^2 for VIS, but slightly deeper than previous estimates for NISP with 1sigma=29.2-29.4 mag/arcsec^2. By combining Euclid HE, YE, and IE into RGB images, we illustrate the large field-of-view covered by a single Reference Observing Sequence, together with exquisite detail on parsec scales in these nearby galaxies. Radial surface brightness and color profiles demonstrate galaxy colors in agreement with stellar population synthesis models. Standard stellar photometry selection techniques find approximately 1.3 million stars across the 6 galaxy fields. Euclid's resolved stellar photometry allows us to constrain the star-formation histories of these galaxies, by disentangling the distributions of young stars, as well as asymptotic giant branch and red giant branch stellar populations. We finally examine 2 galaxies individually for surrounding satellite systems. Our analysis of the ensemble of dwarf satellites around NGC6744 reveals a new galaxy, EDwC1, a nucleated dwarf spheroidal at the end of a spiral arm. Our new census of the globular clusters around NGC2403 yields 9 new star-cluster candidates, 8 of which with colors indicative of evolved stellar populations. In summary, our investigation of the 6 Showcase galaxies demonstrates that Euclid is a powerful probe of the anatomy of nearby galaxies [abridged]. △ Less

Submitted 22 May, 2024; originally announced May 2024.

Comments: 36 pages; 20 figures in main text; 4 Appendices. Submitted to A&A, as part of the A&A special issue `Euclid on Sky', which contains Euclid key reference papers and first results from the Euclid Early Release Observations

Euclid: Early Release Observations -- Unveiling the morphology of two Milky Way globular clusters out to their periphery

Authors: D. Massari, E. Dalessandro, D. Erkal, E. Balbinot, J. Bovy, I. McDonald, A. M. N. Ferguson, S. S. Larsen, A. Lançon, F. Annibali, B. Goldman, P. B. Kuzma, K. Voggel, T. Saifollahi, J. -C. Cuillandre, M. Schirmer, M. Kluge, B. Altieri, A. Amara, S. Andreon, N. Auricchio, M. Baldi, A. Balestra, S. Bardelli, A. Basset , et al. (136 additional authors not shown)

Abstract: As part of the Euclid Early Release Observations (ERO) programme, we analyse deep, wide-field imaging from the VIS and NISP instruments of two Milky Way globular clusters (GCs), namely NGC 6254 (M10) and NGC 6397, to look for observational evidence of their dynamical interaction with the Milky Way. We search for such an interaction in the form of structural and morphological features in the cluste… ▽ More As part of the Euclid Early Release Observations (ERO) programme, we analyse deep, wide-field imaging from the VIS and NISP instruments of two Milky Way globular clusters (GCs), namely NGC 6254 (M10) and NGC 6397, to look for observational evidence of their dynamical interaction with the Milky Way. We search for such an interaction in the form of structural and morphological features in the clusters' outermost regions, which are suggestive of the development of tidal tails on scales larger than those sampled by the ERO programme. Our multi-band photometric analysis results in deep and well-behaved colour-magnitude diagrams that, in turn, enable an accurate membership selection. The surface brightness profiles built from these samples of member stars are the deepest ever obtained for these two Milky Way GCs, reaching down to $\sim30.0$ mag~arcsec$^{-2}$, which is about $1.5$ mag arcsec$^{-2}$ below the current limit. The investigation of the two-dimensional density map of NGC 6254 reveals an elongated morphology of the cluster peripheries in the direction and with the amplitude predicted by $N$-body simulations of the cluster's dynamical evolution, at high statistical significance. We interpret this as strong evidence for the first detection of tidally induced morphological distortion around this cluster. The density map of NGC 6397 reveals a slightly elliptical morphology, in agreement with previous studies, which requires further investigation on larger scales to be properly interpreted. This ERO project thus demonstrates the power of Euclid in studying the outer regions of GCs at an unprecedented level of detail, thanks to the combination of large field of view, high spatial resolution, and depth enabled by the telescope. Our results highlight the future Euclid survey as the ideal data set to investigate GC tidal tails and stellar streams. △ Less

Submitted 22 May, 2024; originally announced May 2024.

Comments: 15 pages, 18 figures. Paper accepted as part of the A&A special issue `Euclid on Sky', which contains Euclid key reference papers and first results from the Euclid Early Release Observations

Euclid: Early Release Observations -- A glance at free-floating new-born planets in the sigma Orionis cluster

Authors: E. L. Martín, M. {Ž}erjal, H. Bouy, D. Martin-Gonzalez, S. Mu{ň}oz Torres, D. Barrado, J. Olivares, A. Pérez-Garrido, P. Mas-Buitrago, P. Cruz, E. Solano, M. R. Zapatero Osorio, N. Lodieu, V. J. S. Béjar, J. -Y. Zhang, C. del Burgo, N. Huélamo, R. Laureijs, A. Mora, T. Saifollahi, J. -C. Cuillandre, M. Schirmer, R. Tata, S. Points, N. Phan-Bao , et al. (153 additional authors not shown)

Abstract: We provide an early assessment of the imaging capabilities of the Euclid space mission to probe deeply into nearby star-forming regions and associated very young open clusters, and in particular to check to what extent it can shed light on the new-born free-floating planet population. This paper focuses on a low-reddening region observed in just one Euclid pointing where the dust and gas has been… ▽ More We provide an early assessment of the imaging capabilities of the Euclid space mission to probe deeply into nearby star-forming regions and associated very young open clusters, and in particular to check to what extent it can shed light on the new-born free-floating planet population. This paper focuses on a low-reddening region observed in just one Euclid pointing where the dust and gas has been cleared out by the hot sigma Orionis star. One late-M and six known spectroscopically confirmed L-type substellar members in the sigma Orionis cluster are used as benchmarks to provide a high-purity procedure to select new candidate members with Euclid. The exquisite angular resolution and depth delivered by the Euclid instruments allow us to focus on bona-fide point sources. A cleaned sample of sigma Orionis cluster substellar members has been produced and the initial mass function (IMF) has been estimated by combining Euclid and Gaia data. Our sigma Orionis substellar IMF is consistent with a power-law distribution with no significant steepening at the planetary-mass end. No evidence of a low-mass cutoff is found down to about 4 Jupiter masses at the young age (3 Myr) of the sigma Orionis open cluster. △ Less

Submitted 22 May, 2024; originally announced May 2024.

Comments: 13 pages, 10 figures, submitted to the A&A special issue on "Euclid on the sky"

Euclid. V. The Flagship galaxy mock catalogue: a comprehensive simulation for the Euclid mission

Authors: Euclid Collaboration, F. J. Castander, P. Fosalba, J. Stadel, D. Potter, J. Carretero, P. Tallada-Crespí, L. Pozzetti, M. Bolzonella, G. A. Mamon, L. Blot, K. Hoffmann, M. Huertas-Company, P. Monaco, E. J. Gonzalez, G. De Lucia, C. Scarlata, M. -A. Breton, L. Linke, C. Viglione, S. -S. Li, Z. Zhai, Z. Baghkhani, K. Pardede, C. Neissner , et al. (344 additional authors not shown)

Abstract: We present the Flagship galaxy mock, a simulated catalogue of billions of galaxies designed to support the scientific exploitation of the Euclid mission. Euclid is a medium-class mission of the European Space Agency optimised to determine the properties of dark matter and dark energy on the largest scales of the Universe. It probes structure formation over more than 10 billion years primarily from… ▽ More We present the Flagship galaxy mock, a simulated catalogue of billions of galaxies designed to support the scientific exploitation of the Euclid mission. Euclid is a medium-class mission of the European Space Agency optimised to determine the properties of dark matter and dark energy on the largest scales of the Universe. It probes structure formation over more than 10 billion years primarily from the combination of weak gravitational lensing and galaxy clustering data. The breath of Euclid's data will also foster a wide variety of scientific analyses. The Flagship simulation was developed to provide a realistic approximation to the galaxies that will be observed by Euclid and used in its scientific analyses. We ran a state-of-the-art N-body simulation with four trillion particles, producing a lightcone on the fly. From the dark matter particles, we produced a catalogue of 16 billion haloes in one octant of the sky in the lightcone up to redshift z=3. We then populated these haloes with mock galaxies using a halo occupation distribution and abundance matching approach, calibrating the free parameters of the galaxy mock against observed correlations and other basic galaxy properties. Modelled galaxy properties include luminosity and flux in several bands, redshifts, positions and velocities, spectral energy distributions, shapes and sizes, stellar masses, star formation rates, metallicities, emission line fluxes, and lensing properties. We selected a final sample of 3.4 billion galaxies with a magnitude cut of H_E<26, where we are complete. We have performed a comprehensive set of validation tests to check the similarity to observational data and theoretical models. In particular, our catalogue is able to closely reproduce the main characteristics of the weak lensing and galaxy clustering samples to be used in the mission's main cosmological analysis. (abridged) △ Less

Submitted 22 May, 2024; originally announced May 2024.

Comments: Paper submitted as part of the A&A special issue `Euclid on Sky', which contains Euclid key reference papers and first results from the Euclid Early Release Observations

Euclid. IV. The NISP Calibration Unit

Authors: Euclid Collaboration, F. Hormuth, K. Jahnke, M. Schirmer, C. G. -Y. Lee, T. Scott, R. Barbier, S. Ferriol, W. Gillard, F. Grupp, R. Holmes, W. Holmes, B. Kubik, J. Macias-Perez, M. Laurent, J. Marpaud, M. Marton, E. Medinaceli, G. Morgante, R. Toledo-Moreo, M. Trifoglio, Hans-Walter Rix, A. Secroun, M. Seiffert, P. Stassi , et al. (310 additional authors not shown)

Abstract: The near-infrared calibration unit (NI-CU) onboard Euclid's Near-Infrared Spectrometer and Photometer (NISP) is the first astronomical calibration lamp based on light-emitting diodes (LEDs) to be operated in space. Euclid is a mission in ESA's 'Cosmic Vision 2015-2025' framework, to explore the dark universe and provide a next-level characterisation of the nature of gravitation, dark matter, and d… ▽ More The near-infrared calibration unit (NI-CU) onboard Euclid's Near-Infrared Spectrometer and Photometer (NISP) is the first astronomical calibration lamp based on light-emitting diodes (LEDs) to be operated in space. Euclid is a mission in ESA's 'Cosmic Vision 2015-2025' framework, to explore the dark universe and provide a next-level characterisation of the nature of gravitation, dark matter, and dark energy. Calibrating photometric and spectrometric measurements of galaxies to better than 1.5% accuracy in a survey homogeneously map** ~14000 deg^2 of extragalactic sky requires a very detailed characterisation of near-infrared (NIR) detector properties, as well their constant monitoring in flight. To cover two of the main contributions - relative pixel-to-pixel sensitivity and non-linearity characteristics - as well as support other calibration activities, NI-CU was designed to provide spatially approximately homogeneous (<12% variations) and temporally stable illumination (0.1%-0.2% over 1200s) over the NISP detector plane, with minimal power consumption and energy dissipation. NI-CU is covers the spectral range ~[900,1900] nm - at cryo-operating temperature - at 5 fixed independent wavelengths to capture wavelength-dependent behaviour of the detectors, with fluence over a dynamic range of >=100 from ~15 ph s^-1 pixel^-1 to >1500 ph s^-1 pixel^-1. For this functionality, NI-CU is based on LEDs. We describe the rationale behind the decision and design process, describe the challenges in sourcing the right LEDs, as well as the qualification process and lessons learned. We also provide a description of the completed NI-CU, its capabilities and performance as well as its limits. NI-CU has been integrated into NISP and the Euclid satellite, and since Euclid's launch in July 2023 has started supporting survey operations. △ Less

Submitted 22 May, 2024; originally announced May 2024.

Comments: Paper submitted as part of the A&A special issue 'Euclid on Sky', which contains Euclid key reference papers and first results from the Euclid Early Release Observations

Euclid. III. The NISP Instrument

Authors: Euclid Collaboration, K. Jahnke, W. Gillard, M. Schirmer, A. Ealet, T. Maciaszek, E. Prieto, R. Barbier, C. Bonoli, L. Corcione, S. Dusini, F. Grupp, F. Hormuth, S. Ligori, L. Martin, G. Morgante, C. Padilla, R. Toledo-Moreo, M. Trifoglio, L. Valenziano, R. Bender, F. J. Castander, B. Garilli, P. B. Lilje, H. -W. Rix , et al. (412 additional authors not shown)

Abstract: The Near-Infrared Spectrometer and Photometer (NISP) on board the Euclid satellite provides multiband photometry and R>=450 slitless grism spectroscopy in the 950-2020nm wavelength range. In this reference article we illuminate the background of NISP's functional and calibration requirements, describe the instrument's integral components, and provide all its key properties. We also sketch the proc… ▽ More The Near-Infrared Spectrometer and Photometer (NISP) on board the Euclid satellite provides multiband photometry and R>=450 slitless grism spectroscopy in the 950-2020nm wavelength range. In this reference article we illuminate the background of NISP's functional and calibration requirements, describe the instrument's integral components, and provide all its key properties. We also sketch the processes needed to understand how NISP operates and is calibrated, and its technical potentials and limitations. Links to articles providing more details and technical background are included. NISP's 16 HAWAII-2RG (H2RG) detectors with a plate scale of 0.3" pix^-1 deliver a field-of-view of 0.57deg^2. In photo mode, NISP reaches a limiting magnitude of ~24.5AB mag in three photometric exposures of about 100s exposure time, for point sources and with a signal-to-noise ratio (SNR) of 5. For spectroscopy, NISP's point-source sensitivity is a SNR = 3.5 detection of an emission line with flux ~2x10^-16erg/s/cm^2 integrated over two resolution elements of 13.4A, in 3x560s grism exposures at 1.6 mu (redshifted Ha). Our calibration includes on-ground and in-flight characterisation and monitoring of detector baseline, dark current, non-linearity, and sensitivity, to guarantee a relative photometric accuracy of better than 1.5%, and relative spectrophotometry to better than 0.7%. The wavelength calibration must be better than 5A. NISP is the state-of-the-art instrument in the NIR for all science beyond small areas available from HST and JWST - and an enormous advance due to its combination of field size and high throughput of telescope and instrument. During Euclid's 6-year survey covering 14000 deg^2 of extragalactic sky, NISP will be the backbone for determining distances of more than a billion galaxies. Its NIR data will become a rich reference imaging and spectroscopy data set for the coming decades. △ Less

Submitted 22 May, 2024; originally announced May 2024.

Comments: Paper submitted as part of the A&A special issue 'Euclid on Sky', which contains Euclid key reference papers and first results from the Euclid Early Release Observations

Euclid. II. The VIS Instrument

Authors: Euclid Collaboration, M. Cropper, A. Al-Bahlawan, J. Amiaux, S. Awan, R. Azzollini, K. Benson, M. Berthe, J. Boucher, E. Bozzo, C. Brockley-Blatt, G. P. Candini, C. Cara, R. A. Chaudery, R. E. Cole, P. Danto, J. Denniston, A. M. Di Giorgio, B. Dryer, J. Endicott, J. -P. Dubois, M. Farina, E. Galli, L. Genolet, J. P. D. Gow , et al. (403 additional authors not shown)

Abstract: This paper presents the specification, design, and development of the Visible Camera (VIS) on the ESA Euclid mission. VIS is a large optical-band imager with a field of view of 0.54 deg^2 sampled at 0.1" with an array of 609 Megapixels and spatial resolution of 0.18". It will be used to survey approximately 14,000 deg^2 of extragalactic sky to measure the distortion of galaxies in the redshift ran… ▽ More This paper presents the specification, design, and development of the Visible Camera (VIS) on the ESA Euclid mission. VIS is a large optical-band imager with a field of view of 0.54 deg^2 sampled at 0.1" with an array of 609 Megapixels and spatial resolution of 0.18". It will be used to survey approximately 14,000 deg^2 of extragalactic sky to measure the distortion of galaxies in the redshift range z=0.1-1.5 resulting from weak gravitational lensing, one of the two principal cosmology probes of Euclid. With photometric redshifts, the distribution of dark matter can be mapped in three dimensions, and, from how this has changed with look-back time, the nature of dark energy and theories of gravity can be constrained. The entire VIS focal plane will be transmitted to provide the largest images of the Universe from space to date, reaching m_AB>24.5 with S/N >10 in a single broad I_E~(r+i+z) band over a six year survey. The particularly challenging aspects of the instrument are the control and calibration of observational biases, which lead to stringent performance requirements and calibration regimes. With its combination of spatial resolution, calibration knowledge, depth, and area covering most of the extra-Galactic sky, VIS will also provide a legacy data set for many other fields. This paper discusses the rationale behind the VIS concept and describes the instrument design and development before reporting the pre-launch performance derived from ground calibrations and brief results from the in-orbit commissioning. VIS should reach fainter than m_AB=25 with S/N>10 for galaxies of full-width half-maximum of 0.3" in a 1.3" diameter aperture over the Wide Survey, and m_AB>26.4 for a Deep Survey that will cover more than 50 deg^2. The paper also describes how VIS works with the other Euclid components of survey, telescope, and science data processing to extract the cosmological information. △ Less

Submitted 22 May, 2024; originally announced May 2024.

Comments: Paper submitted as part of the A&A special issue `Euclid on Sky', which contains Euclid key reference papers and first results from the Euclid Early Release Observations

Euclid. I. Overview of the Euclid mission

Authors: Euclid Collaboration, Y. Mellier, Abdurro'uf, J. A. Acevedo Barroso, A. Achúcarro, J. Adamek, R. Adam, G. E. Addison, N. Aghanim, M. Aguena, V. Ajani, Y. Akrami, A. Al-Bahlawan, A. Alavi, I. S. Albuquerque, G. Alestas, G. Alguero, A. Allaoui, S. W. Allen, V. Allevato, A. V. Alonso-Tetilla, B. Altieri, A. Alvarez-Candal, A. Amara, L. Amendola , et al. (1086 additional authors not shown)

Abstract: The current standard model of cosmology successfully describes a variety of measurements, but the nature of its main ingredients, dark matter and dark energy, remains unknown. Euclid is a medium-class mission in the Cosmic Vision 2015-2025 programme of the European Space Agency (ESA) that will provide high-resolution optical imaging, as well as near-infrared imaging and spectroscopy, over about 14… ▽ More The current standard model of cosmology successfully describes a variety of measurements, but the nature of its main ingredients, dark matter and dark energy, remains unknown. Euclid is a medium-class mission in the Cosmic Vision 2015-2025 programme of the European Space Agency (ESA) that will provide high-resolution optical imaging, as well as near-infrared imaging and spectroscopy, over about 14,000 deg^2 of extragalactic sky. In addition to accurate weak lensing and clustering measurements that probe structure formation over half of the age of the Universe, its primary probes for cosmology, these exquisite data will enable a wide range of science. This paper provides a high-level overview of the mission, summarising the survey characteristics, the various data-processing steps, and data products. We also highlight the main science objectives and expected performance. △ Less

Submitted 22 May, 2024; originally announced May 2024.

Comments: Paper submitted as part of the A&A special issue`Euclid on Sky'

Euclid preparation. Sensitivity to neutrino parameters

Authors: Euclid Collaboration, M. Archidiacono, J. Lesgourgues, S. Casas, S. Pamuk, N. Schöneberg, Z. Sakr, G. Parimbelli, A. Schneider, F. Hervas Peters, F. Pace, V. M. Sabarish, M. Costanzi, S. Camera, C. Carbone, S. Clesse, N. Frusciante, A. Fumagalli, P. Monaco, D. Scott, M. Viel, A. Amara, S. Andreon, N. Auricchio, M. Baldi , et al. (224 additional authors not shown)

Abstract: The Euclid mission of the European Space Agency will deliver weak gravitational lensing and galaxy clustering surveys that can be used to constrain the standard cosmological model and extensions thereof. We present forecasts from the combination of these surveys on the sensitivity to cosmological parameters including the summed neutrino mass $M_ν$ and the effective number of relativistic species… ▽ More The Euclid mission of the European Space Agency will deliver weak gravitational lensing and galaxy clustering surveys that can be used to constrain the standard cosmological model and extensions thereof. We present forecasts from the combination of these surveys on the sensitivity to cosmological parameters including the summed neutrino mass $M_ν$ and the effective number of relativistic species $N_{\rm eff}$ in the standard $Λ$CDM scenario and in a scenario with dynamical dark energy ($w_0 w_a$CDM). We compare the accuracy of different algorithms predicting the nonlinear matter power spectrum for such models. We then validate several pipelines for Fisher matrix and MCMC forecasts, using different theory codes, algorithms for numerical derivatives, and assumptions concerning the non-linear cut-off scale. The Euclid primary probes alone will reach a sensitivity of $σ(M_ν)=$56meV in the $Λ$CDM+$M_ν$ model, whereas the combination with CMB data from Planck is expected to achieve $σ(M_ν)=$23meV and raise the evidence for a non-zero neutrino mass to at least the $2.6σ$ level. This can be pushed to a $4σ$ detection if future CMB data from LiteBIRD and CMB Stage-IV are included. In combination with Planck, Euclid will also deliver tight constraints on $ΔN_{\rm eff}< 0.144$ (95%CL) in the $Λ$CDM+$M_ν$+$N_{\rm eff}$ model, or $ΔN_{\rm eff}< 0.063$ when future CMB data are included. When floating $(w_0, w_a)$, we find that the sensitivity to $N_{\rm eff}$ remains stable, while that to $M_ν$ degrades at most by a factor 2. This work illustrates the complementarity between the Euclid spectroscopic and imaging/photometric surveys and between Euclid and CMB constraints. Euclid will have a great potential for measuring the neutrino mass and excluding well-motivated scenarios with additional relativistic particles. △ Less

Submitted 9 May, 2024; originally announced May 2024.

Comments: 48 pages, 33 figures

Report number: TTK-24-17

Deep Learning for Detecting and Early Predicting Chronic Obstructive Pulmonary Disease from Spirogram Time Series: A UK Biobank Study

Authors: Shuhao Mei, Yuxi Zhou, Jiahao Xu, Yuxuan Wan, Shan Cao, Qinghao Zhao, Shijia Geng, Junqing Xie, Shenda Hong

Abstract: Chronic Obstructive Pulmonary Disease (COPD) is a chronic inflammatory lung condition that causes airflow obstruction. The existing methods can only detect patients who already have COPD based on obvious features shown in the spirogram (In this article, the spirogram specifically involves measuring Volume-Flow curve time series). Early prediction of COPD risk is vital for monitoring COPD disease p… ▽ More Chronic Obstructive Pulmonary Disease (COPD) is a chronic inflammatory lung condition that causes airflow obstruction. The existing methods can only detect patients who already have COPD based on obvious features shown in the spirogram (In this article, the spirogram specifically involves measuring Volume-Flow curve time series). Early prediction of COPD risk is vital for monitoring COPD disease progression, slowing it down, or even preventing its onset. However, these methods fail to early predict an individual's probability of COPD in the future based on subtle features in the spirogram. To address this gap, for the first time, we propose DeepSpiro, a method based on deep learning for early prediction of future COPD risk. DeepSpiro consists of four parts. First, we construct Volume-Flow curves guided by Time-Volume instability smoothing (SpiroSmoother) to enhance the stability of the original Volume-Flow curves precisely. Second, we extract critical features from the evolution of varied-length key patches (SpiroEncoder) to capture the key temporal evolution from original high-dimensional dynamic sequences to a unified low-dimensional temporal representation. Third, we explain the model based on temporal attention and heterogeneous feature fusion (SpiroExplainer), which integrates information from heterogeneous data such as spirogram and demographic information. Fourth, we predict the risk of COPD based on the evolution of key patch concavity (SpiroPredictor), enabling accurate prediction of the risk of disease in high-risk patients who are not yet diagnosed, for up to 1, 2, 3, 4, 5 years, and beyond. We conduct experiments on the UK Biobank dataset. Results show that DeepSpiro achieves an AUC value of 0.8328 in the task of detecting COPD. In early prediction tasks, high-risk and low-risk groups show significant differences in the future, with a p-value of <0.001. △ Less

Submitted 6 May, 2024; originally announced May 2024.

Euclid preparation. LensMC, weak lensing cosmic shear measurement with forward modelling and Markov Chain Monte Carlo sampling

Authors: Euclid Collaboration, G. Congedo, L. Miller, A. N. Taylor, N. Cross, C. A. J. Duncan, T. Kitching, N. Martinet, S. Matthew, T. Schrabback, M. Tewes, N. Welikala, N. Aghanim, A. Amara, S. Andreon, N. Auricchio, M. Baldi, S. Bardelli, R. Bender, C. Bodendorf, D. Bonino, E. Branchini, M. Brescia, J. Brinchmann, S. Camera , et al. (217 additional authors not shown)

Abstract: LensMC is a weak lensing shear measurement method developed for Euclid and Stage-IV surveys. It is based on forward modelling to deal with convolution by a point spread function with comparable size to many galaxies; sampling the posterior distribution of galaxy parameters via Markov Chain Monte Carlo; and marginalisation over nuisance parameters for each of the 1.5 billion galaxies observed by Eu… ▽ More LensMC is a weak lensing shear measurement method developed for Euclid and Stage-IV surveys. It is based on forward modelling to deal with convolution by a point spread function with comparable size to many galaxies; sampling the posterior distribution of galaxy parameters via Markov Chain Monte Carlo; and marginalisation over nuisance parameters for each of the 1.5 billion galaxies observed by Euclid. The scientific performance is quantified through high-fidelity images based on the Euclid Flagship simulations and emulation of the Euclid VIS images; realistic clustering with a mean surface number density of 250 arcmin$^{-2}$ ($I_{\rm E}<29.5$) for galaxies, and 6 arcmin$^{-2}$ ($I_{\rm E}<26$) for stars; and a diffraction-limited chromatic point spread function with a full width at half maximum of $0.^{\!\prime\prime}2$ and spatial variation across the field of view. Objects are measured with a density of 90 arcmin$^{-2}$ ($I_{\rm E}<26.5$) in 4500 deg$^2$. The total shear bias is broken down into measurement (our main focus here) and selection effects (which will be addressed elsewhere). We find: measurement multiplicative and additive biases of $m_1=(-3.6\pm0.2)\times10^{-3}$, $m_2=(-4.3\pm0.2)\times10^{-3}$, $c_1=(-1.78\pm0.03)\times10^{-4}$, $c_2=(0.09\pm0.03)\times10^{-4}$; a large detection bias with a multiplicative component of $1.2\times10^{-2}$ and an additive component of $-3\times10^{-4}$; and a measurement PSF leakage of $α_1=(-9\pm3)\times10^{-4}$ and $α_2=(2\pm3)\times10^{-4}$. When model bias is suppressed, the obtained measurement biases are close to Euclid requirement and largely dominated by undetected faint galaxies ($-5\times10^{-3}$). Although significant, model bias will be straightforward to calibrate given the weak sensitivity. △ Less

Submitted 1 May, 2024; originally announced May 2024.

Comments: 28 pages, 18 figures, 2 tables

U-Nets as Belief Propagation: Efficient Classification, Denoising, and Diffusion in Generative Hierarchical Models

Authors: Song Mei

Abstract: U-Nets are among the most widely used architectures in computer vision, renowned for their exceptional performance in applications such as image segmentation, denoising, and diffusion modeling. However, a theoretical explanation of the U-Net architecture design has not yet been fully established. This paper introduces a novel interpretation of the U-Net architecture by studying certain generativ… ▽ More U-Nets are among the most widely used architectures in computer vision, renowned for their exceptional performance in applications such as image segmentation, denoising, and diffusion modeling. However, a theoretical explanation of the U-Net architecture design has not yet been fully established. This paper introduces a novel interpretation of the U-Net architecture by studying certain generative hierarchical models, which are tree-structured graphical models extensively utilized in both language and image domains. With their encoder-decoder structure, long skip connections, and pooling and up-sampling layers, we demonstrate how U-Nets can naturally implement the belief propagation denoising algorithm in such generative hierarchical models, thereby efficiently approximating the denoising functions. This leads to an efficient sample complexity bound for learning the denoising function using U-Nets within these models. Additionally, we discuss the broader implications of these findings for diffusion models in generative hierarchical models. We also demonstrate that the conventional architecture of convolutional neural networks (ConvNets) is ideally suited for classification tasks within these models. This offers a unified view of the roles of ConvNets and U-Nets, highlighting the versatility of generative hierarchical models in modeling complex data distributions across language and image domains. △ Less

Submitted 1 May, 2024; v1 submitted 29 April, 2024; originally announced April 2024.

Comments: v2 updated discussions of related literature

Reference-Free Multi-Modality Volume Registration of X-Ray Microscopy and Light-Sheet Fluorescence Microscopy

Authors: Siyuan Mei, Fuxin Fan, Mareike Thies, Mingxuan Gu, Fabian Wagner, Oliver Aust, Ina Erceg, Zeynab Mirzaei, Georgiana Neag, Yipeng Sun, Yixing Huang, Andreas Maier

Abstract: Recently, X-ray microscopy (XRM) and light-sheet fluorescence microscopy (LSFM) have emerged as two pivotal imaging tools in preclinical research on bone remodeling diseases, offering micrometer-level resolution. Integrating these complementary modalities provides a holistic view of bone microstructures, facilitating function-oriented volume analysis across different disease cycles. However, regis… ▽ More Recently, X-ray microscopy (XRM) and light-sheet fluorescence microscopy (LSFM) have emerged as two pivotal imaging tools in preclinical research on bone remodeling diseases, offering micrometer-level resolution. Integrating these complementary modalities provides a holistic view of bone microstructures, facilitating function-oriented volume analysis across different disease cycles. However, registering such independently acquired large-scale volumes is extremely challenging under real and reference-free scenarios. This paper presents a fast two-stage pipeline for volume registration of XRM and LSFM. The first stage extracts the surface features and employs two successive point cloud-based methods for coarse alignment. The second stage fine-tunes the initial alignment using a modified cross-correlation method, ensuring precise volumetric registration. Moreover, we propose residual similarity as a novel metric to assess the alignment of two complementary modalities. The results imply robust gradual improvement across the stages. In the end, all correlating microstructures, particularly lacunae in XRM and bone cells in LSFM, are precisely matched, enabling new insights into bone diseases like osteoporosis which are a substantial burden in aging societies. △ Less

Submitted 23 April, 2024; originally announced April 2024.

Differentiable Score-Based Likelihoods: Learning CT Motion Compensation From Clean Images

Authors: Mareike Thies, Noah Maul, Siyuan Mei, Laura Pfaff, Nastassia Vysotskaya, Mingxuan Gu, Jonas Utz, Dennis Possart, Lukas Folle, Fabian Wagner, Andreas Maier

Abstract: Motion artifacts can compromise the diagnostic value of computed tomography (CT) images. Motion correction approaches require a per-scan estimation of patient-specific motion patterns. In this work, we train a score-based model to act as a probability density estimator for clean head CT images. Given the trained model, we quantify the deviation of a given motion-affected CT image from the ideal di… ▽ More Motion artifacts can compromise the diagnostic value of computed tomography (CT) images. Motion correction approaches require a per-scan estimation of patient-specific motion patterns. In this work, we train a score-based model to act as a probability density estimator for clean head CT images. Given the trained model, we quantify the deviation of a given motion-affected CT image from the ideal distribution through likelihood computation. We demonstrate that the likelihood can be utilized as a surrogate metric for motion artifact severity in the CT image facilitating the application of an iterative, gradient-based motion compensation algorithm. By optimizing the underlying motion parameters to maximize likelihood, our method effectively reduces motion artifacts, bringing the image closer to the distribution of motion-free scans. Our approach achieves comparable performance to state-of-the-art methods while eliminating the need for a representative data set of motion-affected samples. This is particularly advantageous in real-world applications, where patient motion patterns may exhibit unforeseen variability, ensuring robustness without implicit assumptions about recoverable motion types. △ Less

Submitted 23 April, 2024; originally announced April 2024.

Euclid preparation. Improving cosmological constraints using a new multi-tracer method with the spectroscopic and photometric samples

Authors: Euclid Collaboration, F. Dournac, A. Blanchard, S. Ilić, B. Lamine, I. Tutusaus, A. Amara, S. Andreon, N. Auricchio, H. Aussel, M. Baldi, S. Bardelli, C. Bodendorf, D. Bonino, E. Branchini, S. Brau-Nogue, M. Brescia, J. Brinchmann, S. Camera, V. Capobianco, J. Carretero, S. Casas, M. Castellano, S. Cavuoti, A. Cimatti , et al. (218 additional authors not shown)

Abstract: Future data provided by the \Euclid mission will allow us to better understand the cosmic history of the Universe. A metric of its performance is the figure-of-merit (FoM) of dark energy, usually estimated with Fisher forecasts. The expected FoM has previously been estimated taking into account the two main probes of \Euclid, namely the three-dimensional clustering of the spectroscopic galaxy samp… ▽ More Future data provided by the \Euclid mission will allow us to better understand the cosmic history of the Universe. A metric of its performance is the figure-of-merit (FoM) of dark energy, usually estimated with Fisher forecasts. The expected FoM has previously been estimated taking into account the two main probes of \Euclid, namely the three-dimensional clustering of the spectroscopic galaxy sample, and the so-called 3$\times$2\,pt signal from the photometric sample (i.e., the weak lensing signal, the galaxy clustering, and their cross-correlation). So far, these two probes have been treated as independent. In this paper, we introduce a new observable given by the ratio of the (angular) two-point correlation function of galaxies from the two surveys. For identical (normalised) selection functions, this observable is unaffected by sampling noise, and its variance is solely controlled by Poisson noise. We present forecasts for \Euclid where this multi-tracer method is applied and is particularly relevant because the two surveys will cover the same area of the sky. This method allows for the exploitation of the combination of the spectroscopic and photometric samples. When the correlation between this new observable and the other probes is not taken into account, a significant gain is obtained in the FoM, as well as in the constraints on other cosmological parameters. The benefit is more pronounced for a commonly investigated modified gravity model, namely the $γ$ parametrisation of the growth factor. However, the correlation between the different probes is found to be significant and hence the actual gain is uncertain. We present various strategies for circumventing this issue and still extract useful information from the new observable. △ Less

Submitted 18 April, 2024; originally announced April 2024.

Comments: 16 pages, 7 figures, submitted to A&A

Euclid preparation. XLII. A unified catalogue-level reanalysis of weak lensing by galaxy clusters in five imaging surveys

Authors: Euclid Collaboration, M. Sereno, S. Farrens, L. Ingoglia, G. F. Lesci, L. Baumont, G. Covone, C. Giocoli, F. Marulli, S. Miranda La Hera, M. Vannier, A. Biviano, S. Maurogordato, L. Moscardini, N. Aghanim, S. Andreon, N. Auricchio, M. Baldi, S. Bardelli, F. Bellagamba, C. Bodendorf, D. Bonino, E. Branchini, M. Brescia, J. Brinchmann , et al. (199 additional authors not shown)

Abstract: Precise and accurate mass calibration is required to exploit galaxy clusters as astrophysical and cosmological probes in the Euclid era. Systematic errors in lensing signals by galaxy clusters can be empirically estimated by comparing different surveys with independent and uncorrelated systematics. To assess the robustness of the lensing results to systematic errors, we carried out end-to-end test… ▽ More Precise and accurate mass calibration is required to exploit galaxy clusters as astrophysical and cosmological probes in the Euclid era. Systematic errors in lensing signals by galaxy clusters can be empirically estimated by comparing different surveys with independent and uncorrelated systematics. To assess the robustness of the lensing results to systematic errors, we carried out end-to-end tests across different data sets. We performed a unified analysis at the catalogue level by leveraging the Euclid combined cluster and weak-lensing pipeline (COMB-CL). COMB-CL will measure weak lensing cluster masses for the Euclid Survey. Heterogeneous data sets from five independent, recent, lensing surveys (CHFTLenS, DES~SV1, HSC-SSP~S16a, KiDS~DR4, and RCSLenS), which exploited different shear and photometric redshift estimation algorithms, were analysed with a consistent pipeline under the same model assumptions. We performed a comparison of the amplitude of the reduced excess surface density and of the mass estimates using lenses from the Planck PSZ2 and SDSS redMaPPer cluster samples. Mass estimates agree with literature results collected in the LC2 catalogues. Mass accuracy was further investigated considering the AMICO detected clusters in the HSC-SSP XXL North field. The consistency of the data sets was tested using our unified analysis framework. We found agreement between independent surveys, at the level of systematic noise in Stage-III surveys or precursors. This indicates successful control over systematics. If such control continues in Stage-IV, Euclid will be able to measure the weak lensing masses of around 13000 (considering shot noise only) or 3000 (noise from shape and large-scale-structure) massive clusters with a signal-to-noise ratio greater than 3. △ Less

Submitted 11 April, 2024; originally announced April 2024.

Comments: 25 pages; in press on A&A

An Overview of Diffusion Models: Applications, Guided Generation, Statistical Rates and Optimization

Authors: Minshuo Chen, Song Mei, Jianqing Fan, Mengdi Wang

Abstract: Diffusion models, a powerful and universal generative AI technology, have achieved tremendous success in computer vision, audio, reinforcement learning, and computational biology. In these applications, diffusion models provide flexible high-dimensional data modeling, and act as a sampler for generating new samples under active guidance towards task-desired properties. Despite the significant empi… ▽ More Diffusion models, a powerful and universal generative AI technology, have achieved tremendous success in computer vision, audio, reinforcement learning, and computational biology. In these applications, diffusion models provide flexible high-dimensional data modeling, and act as a sampler for generating new samples under active guidance towards task-desired properties. Despite the significant empirical success, theory of diffusion models is very limited, potentially slowing down principled methodological innovations for further harnessing and improving diffusion models. In this paper, we review emerging applications of diffusion models, understanding their sample generation under various controls. Next, we overview the existing theories of diffusion models, covering their statistical properties and sampling capabilities. We adopt a progressive routine, beginning with unconditional diffusion models and connecting to conditional counterparts. Further, we review a new avenue in high-dimensional structured optimization through conditional diffusion models, where searching for solutions is reformulated as a conditional sampling problem and solved by diffusion models. Lastly, we discuss future directions about diffusion models. The purpose of this paper is to provide a well-rounded theoretical exposure for stimulating forward-looking theories and methods of diffusion models. △ Less

Submitted 11 April, 2024; originally announced April 2024.

Negative Preference Optimization: From Catastrophic Collapse to Effective Unlearning

Authors: Ruiqi Zhang, Licong Lin, Yu Bai, Song Mei

Abstract: Large Language Models (LLMs) often memorize sensitive, private, or copyrighted data during pre-training. LLM unlearning aims to eliminate the influence of undesirable data from the pre-trained model while preserving the model's utilities on other tasks. Several practical methods have recently been proposed for LLM unlearning, mostly based on gradient ascent (GA) on the loss of undesirable data. Ho… ▽ More Large Language Models (LLMs) often memorize sensitive, private, or copyrighted data during pre-training. LLM unlearning aims to eliminate the influence of undesirable data from the pre-trained model while preserving the model's utilities on other tasks. Several practical methods have recently been proposed for LLM unlearning, mostly based on gradient ascent (GA) on the loss of undesirable data. However, on certain unlearning tasks, these methods either fail to effectively unlearn the target data or suffer from catastrophic collapse -- a drastic degradation of the model's utilities. In this paper, we propose Negative Preference Optimization (NPO), a simple alignment-inspired method that could efficiently and effectively unlearn a target dataset. We theoretically show that the progression toward catastrophic collapse by minimizing the NPO loss is exponentially slower than GA. Through experiments on synthetic data and the benchmark TOFU dataset, we demonstrate that NPO-based methods achieve a better balance between unlearning the undesirable data and maintaining the model's utilities. We also observe that NPO-based methods generate more sensible outputs than GA-based methods, whose outputs are often gibberish. Remarkably, on TOFU, NPO-based methods are the first to achieve reasonable unlearning results in forgetting 50% (or more) of the training data, whereas existing methods already struggle with forgetting 10% of training data. △ Less

Submitted 8 April, 2024; originally announced April 2024.

Segmentation-Guided Knee Radiograph Generation using Conditional Diffusion Models

Authors: Siyuan Mei, Fuxin Fan, Fabian Wagner, Mareike Thies, Mingxuan Gu, Yipeng Sun, Andreas Maier

Abstract: Deep learning-based medical image processing algorithms require representative data during development. In particular, surgical data might be difficult to obtain, and high-quality public datasets are limited. To overcome this limitation and augment datasets, a widely adopted solution is the generation of synthetic images. In this work, we employ conditional diffusion models to generate knee radiog… ▽ More Deep learning-based medical image processing algorithms require representative data during development. In particular, surgical data might be difficult to obtain, and high-quality public datasets are limited. To overcome this limitation and augment datasets, a widely adopted solution is the generation of synthetic images. In this work, we employ conditional diffusion models to generate knee radiographs from contour and bone segmentations. Remarkably, two distinct strategies are presented by incorporating the segmentation as a condition into the sampling and training process, namely, conditional sampling and conditional training. The results demonstrate that both methods can generate realistic images while adhering to the conditioning segmentation. The conditional training method outperforms the conditional sampling method and the conventional U-Net. △ Less

Submitted 4 April, 2024; originally announced April 2024.

Analysing Diffusion Segmentation for Medical Images

Authors: Mathias Öttl, Siyuan Mei, Frauke Wilm, Jana Steenpass, Matthias Rübner, Arndt Hartmann, Matthias Beckmann, Peter Fasching, Andreas Maier, Ramona Erber, Katharina Breininger

Abstract: Denoising Diffusion Probabilistic models have become increasingly popular due to their ability to offer probabilistic modeling and generate diverse outputs. This versatility inspired their adaptation for image segmentation, where multiple predictions of the model can produce segmentation results that not only achieve high quality but also capture the uncertainty inherent in the model. Here, powerf… ▽ More Denoising Diffusion Probabilistic models have become increasingly popular due to their ability to offer probabilistic modeling and generate diverse outputs. This versatility inspired their adaptation for image segmentation, where multiple predictions of the model can produce segmentation results that not only achieve high quality but also capture the uncertainty inherent in the model. Here, powerful architectures were proposed for improving diffusion segmentation performance. However, there is a notable lack of analysis and discussions on the differences between diffusion segmentation and image generation, and thorough evaluations are missing that distinguish the improvements these architectures provide for segmentation in general from their benefit for diffusion segmentation specifically. In this work, we critically analyse and discuss how diffusion segmentation for medical images differs from diffusion image generation, with a particular focus on the training behavior. Furthermore, we conduct an assessment how proposed diffusion segmentation architectures perform when trained directly for segmentation. Lastly, we explore how different medical segmentation tasks influence the diffusion segmentation behavior and the diffusion process could be adapted accordingly. With these analyses, we aim to provide in-depth insights into the behavior of diffusion segmentation that allow for a better design and evaluation of diffusion segmentation methods in the future. △ Less

Submitted 21 March, 2024; originally announced March 2024.

EAGLE: An Edge-Aware Gradient Localization Enhanced Loss for CT Image Reconstruction

Authors: Yipeng Sun, Yixing Huang, Linda-Sophie Schneider, Mareike Thies, Mingxuan Gu, Siyuan Mei, Siming Bayer, Andreas Maier

Abstract: Computed Tomography (CT) image reconstruction is crucial for accurate diagnosis and deep learning approaches have demonstrated significant potential in improving reconstruction quality. However, the choice of loss function profoundly affects the reconstructed images. Traditional mean squared error loss often produces blurry images lacking fine details, while alternatives designed to improve may in… ▽ More Computed Tomography (CT) image reconstruction is crucial for accurate diagnosis and deep learning approaches have demonstrated significant potential in improving reconstruction quality. However, the choice of loss function profoundly affects the reconstructed images. Traditional mean squared error loss often produces blurry images lacking fine details, while alternatives designed to improve may introduce structural artifacts or other undesirable effects. To address these limitations, we propose Eagle-Loss, a novel loss function designed to enhance the visual quality of CT image reconstructions. Eagle-Loss applies spectral analysis of localized features within gradient changes to enhance sharpness and well-defined edges. We evaluated Eagle-Loss on two public datasets across low-dose CT reconstruction and CT field-of-view extension tasks. Our results show that Eagle-Loss consistently improves the visual quality of reconstructed images, surpassing state-of-the-art methods across various network architectures. Code and data are available at \url{https://github.com/sypsyp97/Eagle_Loss}. △ Less

Submitted 15 March, 2024; originally announced March 2024.

Comments: Preprint

Euclid: Testing photometric selection of emission-line galaxy targets

Authors: M. S. Cagliari, B. R. Granett, L. Guzzo, M. Bethermin, M. Bolzonella, S. de la Torre, P. Monaco, M. Moresco, W. J. Percival, C. Scarlata, Y. Wang, M. Ezziati, O. Ilbert, V. Le Brun, A. Amara, S. Andreon, N. Auricchio, M. Baldi, S. Bardelli, R. Bender, C. Bodendorf, E. Branchini, M. Brescia, J. Brinchmann, S. Camera , et al. (122 additional authors not shown)

Abstract: Multi-object spectroscopic galaxy surveys typically make use of photometric and colour criteria to select targets. Conversely, the Euclid NISP slitless spectrograph will record spectra for every source over its field of view. Slitless spectroscopy has the advantage of avoiding defining a priori a galaxy sample, but at the price of making the selection function harder to quantify. The Euclid Wide S… ▽ More Multi-object spectroscopic galaxy surveys typically make use of photometric and colour criteria to select targets. Conversely, the Euclid NISP slitless spectrograph will record spectra for every source over its field of view. Slitless spectroscopy has the advantage of avoiding defining a priori a galaxy sample, but at the price of making the selection function harder to quantify. The Euclid Wide Survey aims at building robust statistical samples of emission-line galaxies with fluxes in the Halpha-NII complex brighter than 2e-16 erg/s/cm^2 and within 0.9<z<1.8. At faint fluxes, we expect significant contamination by wrongly measured redshifts, either due to emission-line misidentification or noise fluctuations, with the consequence of reducing the purity of the final samples. This can be significantly improved by exploiting Euclid photometric information to identify emission-line galaxies over the redshifts of interest. To this goal, we compare and quantify the performance of six machine-learning classification algorithms. We consider the case when only Euclid photometric and morphological measurements are used and when these are supplemented by ground-based photometric data. We train and test the classifiers on two mock galaxy samples, the EL-COSMOS and Euclid Flagship2 catalogues. Dense neural networks and support vector classifiers obtain the best performance, with comparable results in terms of the adopted metrics. When training on Euclid photometry alone, these can remove 87% of the sources that are fainter than the nominal flux limit or lie outside the range 0.9<z<1.8, a figure that increases to 97% when ground-based photometry is included. These results show how by using the photometric information available to Euclid it will be possible to efficiently identify and discard spurious interlopers, allowing us to build robust spectroscopic samples for cosmological investigations. △ Less

Submitted 13 March, 2024; originally announced March 2024.

Comments: 19 pages, 12+3 figures, submitted to A&A

Statistical Estimation in the Spiked Tensor Model via the Quantum Approximate Optimization Algorithm

Authors: Leo Zhou, Joao Basso, Song Mei

Abstract: The quantum approximate optimization algorithm (QAOA) is a general-purpose algorithm for combinatorial optimization. In this paper, we analyze the performance of the QAOA on a statistical estimation problem, namely, the spiked tensor model, which exhibits a statistical-computational gap classically. We prove that the weak recovery threshold of $1$-step QAOA matches that of $1$-step tensor power it… ▽ More The quantum approximate optimization algorithm (QAOA) is a general-purpose algorithm for combinatorial optimization. In this paper, we analyze the performance of the QAOA on a statistical estimation problem, namely, the spiked tensor model, which exhibits a statistical-computational gap classically. We prove that the weak recovery threshold of $1$-step QAOA matches that of $1$-step tensor power iteration. Additional heuristic calculations suggest that the weak recovery threshold of $p$-step QAOA matches that of $p$-step tensor power iteration when $p$ is a fixed constant. This further implies that multi-step QAOA with tensor unfolding could achieve, but not surpass, the classical computation threshold $Θ(n^{(q-2)/4})$ for spiked $q$-tensors. Meanwhile, we characterize the asymptotic overlap distribution for $p$-step QAOA, finding an intriguing sine-Gaussian law verified through simulations. For some $p$ and $q$, the QAOA attains an overlap that is larger by a constant factor than the tensor power iteration overlap. Of independent interest, our proof techniques employ the Fourier transform to handle difficult combinatorial sums, a novel approach differing from prior QAOA analyses on spin-glass models without planted structure. △ Less

Submitted 29 February, 2024; originally announced February 2024.

Comments: 51 pages, 4 figures, 1 table

MemoNav: Working Memory Model for Visual Navigation

Authors: Hongxin Li, Zeyu Wang, Xu Yang, Yuran Yang, Shuqi Mei, Zhaoxiang Zhang

Abstract: Image-goal navigation is a challenging task that requires an agent to navigate to a goal indicated by an image in unfamiliar environments. Existing methods utilizing diverse scene memories suffer from inefficient exploration since they use all historical observations for decision-making without considering the goal-relevant fraction. To address this limitation, we present MemoNav, a novel memory m… ▽ More Image-goal navigation is a challenging task that requires an agent to navigate to a goal indicated by an image in unfamiliar environments. Existing methods utilizing diverse scene memories suffer from inefficient exploration since they use all historical observations for decision-making without considering the goal-relevant fraction. To address this limitation, we present MemoNav, a novel memory model for image-goal navigation, which utilizes a working memory-inspired pipeline to improve navigation performance. Specifically, we employ three types of navigation memory. The node features on a map are stored in the short-term memory (STM), as these features are dynamically updated. A forgetting module then retains the informative STM fraction to increase efficiency. We also introduce long-term memory (LTM) to learn global scene representations by progressively aggregating STM features. Subsequently, a graph attention module encodes the retained STM and the LTM to generate working memory (WM) which contains the scene features essential for efficient navigation. The synergy among these three memory types boosts navigation performance by enabling the agent to learn and leverage goal-relevant scene features within a topological map. Our evaluation on multi-goal tasks demonstrates that MemoNav significantly outperforms previous methods across all difficulty levels in both Gibson and Matterport3D scenes. Qualitative results further illustrate that MemoNav plans more efficient routes. △ Less

Submitted 28 March, 2024; v1 submitted 29 February, 2024; originally announced February 2024.

Comments: Accepted to CVPR 2024. Code: https://github.com/ZJULiHongxin/MemoNav

Anchor-free Clustering based on Anchor Graph Factorization

Authors: Shikun Mei, Fangfang Li, Quanxue Gao, Ming Yang

Abstract: Anchor-based methods are a pivotal approach in handling clustering of large-scale data. However, these methods typically entail two distinct stages: selecting anchor points and constructing an anchor graph. This bifurcation, along with the initialization of anchor points, significantly influences the overall performance of the algorithm. To mitigate these issues, we introduce a novel method termed… ▽ More Anchor-based methods are a pivotal approach in handling clustering of large-scale data. However, these methods typically entail two distinct stages: selecting anchor points and constructing an anchor graph. This bifurcation, along with the initialization of anchor points, significantly influences the overall performance of the algorithm. To mitigate these issues, we introduce a novel method termed Anchor-free Clustering based on Anchor Graph Factorization (AFCAGF). AFCAGF innovates in learning the anchor graph, requiring only the computation of pairwise distances between samples. This process, achievable through straightforward optimization, circumvents the necessity for explicit selection of anchor points. More concretely, our approach enhances the Fuzzy k-means clustering algorithm (FKM), introducing a new manifold learning technique that obviates the need for initializing cluster centers. Additionally, we evolve the concept of the membership matrix between cluster centers and samples in FKM into an anchor graph encompassing multiple anchor points and samples. Employing Non-negative Matrix Factorization (NMF) on this anchor graph allows for the direct derivation of cluster labels, thereby eliminating the requirement for further post-processing steps. To solve the method proposed, we implement an alternating optimization algorithm that ensures convergence. Empirical evaluations on various real-world datasets underscore the superior efficacy of our algorithm compared to traditional approaches. △ Less

Submitted 23 February, 2024; originally announced February 2024.

Euclid preparation. Measuring detailed galaxy morphologies for Euclid with Machine Learning

Authors: Euclid Collaboration, B. Aussel, S. Kruk, M. Walmsley, M. Huertas-Company, M. Castellano, C. J. Conselice, M. Delli Veneri, H. Domínguez Sánchez, P. -A. Duc, U. Kuchner, A. La Marca, B. Margalef-Bentabol, F. R. Marleau, G. Stevens, Y. Toba, C. Tortora, L. Wang, N. Aghanim, B. Altieri, A. Amara, S. Andreon, N. Auricchio, M. Baldi, S. Bardelli , et al. (233 additional authors not shown)

Abstract: The Euclid mission is expected to image millions of galaxies with high resolution, providing an extensive dataset to study galaxy evolution. We investigate the application of deep learning to predict the detailed morphologies of galaxies in Euclid using Zoobot a convolutional neural network pretrained with 450000 galaxies from the Galaxy Zoo project. We adapted Zoobot for emulated Euclid images, g… ▽ More The Euclid mission is expected to image millions of galaxies with high resolution, providing an extensive dataset to study galaxy evolution. We investigate the application of deep learning to predict the detailed morphologies of galaxies in Euclid using Zoobot a convolutional neural network pretrained with 450000 galaxies from the Galaxy Zoo project. We adapted Zoobot for emulated Euclid images, generated based on Hubble Space Telescope COSMOS images, and with labels provided by volunteers in the Galaxy Zoo: Hubble project. We demonstrate that the trained Zoobot model successfully measures detailed morphology for emulated Euclid images. It effectively predicts whether a galaxy has features and identifies and characterises various features such as spiral arms, clumps, bars, disks, and central bulges. When compared to volunteer classifications Zoobot achieves mean vote fraction deviations of less than 12% and an accuracy above 91% for the confident volunteer classifications across most morphology types. However, the performance varies depending on the specific morphological class. For the global classes such as disk or smooth galaxies, the mean deviations are less than 10%, with only 1000 training galaxies necessary to reach this performance. For more detailed structures and complex tasks like detecting and counting spiral arms or clumps, the deviations are slightly higher, around 12% with 60000 galaxies used for training. In order to enhance the performance on complex morphologies, we anticipate that a larger pool of labelled galaxies is needed, which could be obtained using crowdsourcing. Finally, our findings imply that the model can be effectively adapted to new morphological labels. We demonstrate this adaptability by applying Zoobot to peculiar galaxies. In summary, our trained Zoobot CNN can readily predict morphological catalogues for Euclid images. △ Less

Submitted 15 February, 2024; originally announced February 2024.

Comments: 27 pages, 26 figures, 5 tables, submitted to A&A

Euclid preparation. Optical emission-line predictions of intermediate-z galaxy populations in GAEA for the Euclid Deep and Wide Surveys

Authors: Euclid Collaboration, L. Scharré, M. Hirschmann, G. De Lucia, S. Charlot, F. Fontanot, M. Spinelli, L. Xie, A. Feltre, V. Allevato, A. Plat, M. N. Bremer, S. Fotopoulou, L. Gabarra, B. R. Granett, M. Moresco, C. Scarlata, L. Pozzetti, L. Spinoglio, M. Talia, G. Zamorani, B. Altieri, A. Amara, S. Andreon, N. Auricchio , et al. (217 additional authors not shown)

Abstract: In anticipation of the Euclid Wide and Deep Surveys, we present optical emission-line predictions at intermediate redshifts from 0.4 to 2.5. Our approach combines a mock light cone from the GAEA semi-analytic model to self-consistently model nebular emission from HII regions, narrow-line regions of active galactic nuclei (AGN), and evolved stellar populations. Our analysis focuses on seven optical… ▽ More In anticipation of the Euclid Wide and Deep Surveys, we present optical emission-line predictions at intermediate redshifts from 0.4 to 2.5. Our approach combines a mock light cone from the GAEA semi-analytic model to self-consistently model nebular emission from HII regions, narrow-line regions of active galactic nuclei (AGN), and evolved stellar populations. Our analysis focuses on seven optical emission lines: H$α$, H$β$, [SII]$λλ6717, 6731$, [NII]$λ6584$, [OI]$λ6300$, [OIII]$λ5007$, and [OII]$λλ3727, 3729$. We find that Euclid will predominantly observe massive, star-forming, and metal-rich line-emitters. Interstellar dust, modelled using a Calzetti law with mass-dependent scaling, may decrease observable percentages by a further 20-30% with respect to our underlying emission-line populations from GAEA. We predict Euclid to observe around 30-70% of H$α$-, [NII]-, [SII]-, and [OIII]-emitting galaxies at redshift below 1 and under 10% at higher redshift. Observability of H$β$-, [OII]-, and [OI]- emission is limited to below 5%. For the Euclid-observable sample, we find that BPT diagrams can effectively distinguish between different galaxy types up to around redshift 1.8, attributed to the bias toward metal-rich systems. Moreover, we show that the relationships of H$α$ and [OIII]+H$β$ to the star-formation rate, and the [OIII]-AGN luminosity relation, exhibit minimal changes with increasing redshift. Based on line ratios [NII]/H$α$, [NII]/[OII], and [NII]/[SII], we further propose novel z-invariant tracers for the black hole accretion rate-to-star formation rate ratio. Lastly, we find that commonly used metallicity estimators display gradual shifts in normalisations with increasing redshift, while maintaining the overall shape of local calibrations. This is in tentative agreement with recent JWST data. △ Less

Submitted 5 February, 2024; originally announced February 2024.

Comments: 32 pages, 15 figures, submitted to A&A

Euclid preparation XLVI. The Near-IR Background Dipole Experiment with Euclid

Authors: Euclid Collaboration, A. Kashlinsky, R. G. Arendt, M. L. N. Ashby, F. Atrio-Barandela, R. Scaramella, M. A. Strauss, B. Altieri, A. Amara, S. Andreon, N. Auricchio, M. Baldi, S. Bardelli, R. Bender, C. Bodendorf, E. Branchini, M. Brescia, J. Brinchmann, S. Camera, V. Capobianco, C. Carbone, J. Carretero, S. Casas, M. Castellano, S. Cavuoti , et al. (195 additional authors not shown)

Abstract: Verifying the fully kinematic nature of the cosmic microwave background (CMB) dipole is of fundamental importance in cosmology. In the standard cosmological model with the Friedman-Lemaitre-Robertson-Walker (FLRW) metric from the inflationary expansion the CMB dipole should be entirely kinematic. Any non-kinematic CMB dipole component would thus reflect the preinflationary structure of spacetime p… ▽ More Verifying the fully kinematic nature of the cosmic microwave background (CMB) dipole is of fundamental importance in cosmology. In the standard cosmological model with the Friedman-Lemaitre-Robertson-Walker (FLRW) metric from the inflationary expansion the CMB dipole should be entirely kinematic. Any non-kinematic CMB dipole component would thus reflect the preinflationary structure of spacetime probing the extent of the FLRW applicability. Cosmic backgrounds from galaxies after the matter-radiation decoupling, should have kinematic dipole component identical in velocity with the CMB kinematic dipole. Comparing the two can lead to isolating the CMB non-kinematic dipole. It was recently proposed that such measurement can be done using the near-IR cosmic infrared background (CIB) measured with the currently operating Euclid telescope, and later with Roman. The proposed method reconstructs the resolved CIB, the Integrated Galaxy Light (IGL), from Euclid's Wide Survey and probes its dipole, with a kinematic component amplified over that of the CMB by the Compton-Getting effect. The amplification coupled with the extensive galaxy samples forming the IGL would determine the CIB dipole with an overwhelming signal/noise, isolating its direction to sub-degree accuracy. We develop details of the method for Euclid's Wide Survey in 4 bands spanning 0.6 to 2 mic. We isolate the systematic and other uncertainties and present methodologies to minimize them, after confining the sample to the magnitude range with negligible IGL/CIB dipole from galaxy clustering. These include the required star-galaxy separation, accounting for the extinction correction dipole using the method newly developed here achieving total separation, accounting for the Earth's orbital motion and other systematic effects. (Abridged) △ Less

Submitted 24 June, 2024; v1 submitted 31 January, 2024; originally announced January 2024.

Comments: Euclid Key Project paper, A&A, in press

Data-Driven Filter Design in FBP: Transforming CT Reconstruction with Trainable Fourier Series

Authors: Yipeng Sun, Linda-Sophie Schneider, Fuxin Fan, Mareike Thies, Mingxuan Gu, Siyuan Mei, Yuzhong Zhou, Siming Bayer, Andreas Maier

Abstract: In this study, we introduce a Fourier series-based trainable filter for computed tomography (CT) reconstruction within the filtered backprojection (FBP) framework. This method overcomes the limitation in noise reduction, inherent in conventional FBP methods, by optimizing Fourier series coefficients to construct the filter. This method enables robust performance across different resolution scales… ▽ More In this study, we introduce a Fourier series-based trainable filter for computed tomography (CT) reconstruction within the filtered backprojection (FBP) framework. This method overcomes the limitation in noise reduction, inherent in conventional FBP methods, by optimizing Fourier series coefficients to construct the filter. This method enables robust performance across different resolution scales and maintains computational efficiency with minimal increment for the trainable parameters compared to other deep learning frameworks. Additionally, we propose Gaussian edge-enhanced (GEE) loss function that prioritizes the $L_1$ norm of high-frequency magnitudes, effectively countering the blurring problems prevalent in mean squared error (MSE) approaches. The model's foundation in the FBP algorithm ensures excellent interpretability, as it relies on a data-driven filter with all other parameters derived through rigorous mathematical procedures. Designed as a plug-and-play solution, our Fourier series-based filter can be easily integrated into existing CT reconstruction models, making it a versatile tool for a wide range of practical applications. Our research presents a robust and scalable method that expands the utility of FBP in both medical and scientific imaging. △ Less

Submitted 29 January, 2024; originally announced January 2024.

Comments: Preprint

A gradient-based approach to fast and accurate head motion compensation in cone-beam CT

Authors: Mareike Thies, Fabian Wagner, Noah Maul, Haijun Yu, Manuela Meier, Linda-Sophie Schneider, Mingxuan Gu, Siyuan Mei, Lukas Folle, Andreas Maier

Abstract: Cone-beam computed tomography (CBCT) systems, with their portability, present a promising avenue for direct point-of-care medical imaging, particularly in critical scenarios such as acute stroke assessment. However, the integration of CBCT into clinical workflows faces challenges, primarily linked to long scan duration resulting in patient motion during scanning and leading to image quality degrad… ▽ More Cone-beam computed tomography (CBCT) systems, with their portability, present a promising avenue for direct point-of-care medical imaging, particularly in critical scenarios such as acute stroke assessment. However, the integration of CBCT into clinical workflows faces challenges, primarily linked to long scan duration resulting in patient motion during scanning and leading to image quality degradation in the reconstructed volumes. This paper introduces a novel approach to CBCT motion estimation using a gradient-based optimization algorithm, which leverages generalized derivatives of the backprojection operator for cone-beam CT geometries. Building on that, a fully differentiable target function is formulated which grades the quality of the current motion estimate in reconstruction space. We drastically accelerate motion estimation yielding a 19-fold speed-up compared to existing methods. Additionally, we investigate the architecture of networks used for quality metric regression and propose predicting voxel-wise quality maps, favoring autoencoder-like architectures over contracting ones. This modification improves gradient flow, leading to more accurate motion estimation. The presented method is evaluated through realistic experiments on head anatomy. It achieves a reduction in reprojection error from an initial average of 3mm to 0.61mm after motion compensation and consistently demonstrates superior performance compared to existing approaches. The analytic Jacobian for the backprojection operation, which is at the core of the proposed method, is made publicly available. In summary, this paper contributes to the advancement of CBCT integration into clinical workflows by proposing a robust motion estimation approach that enhances efficiency and accuracy, addressing critical challenges in time-sensitive scenarios. △ Less

Submitted 17 January, 2024; originally announced January 2024.

Comments: This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible

Euclid: Improving the efficiency of weak lensing shear bias calibration. Pixel noise cancellation and the response method on trial

Authors: H. Jansen, M. Tewes, T. Schrabback, N. Aghanim, A. Amara, S. Andreon, N. Auricchio, M. Baldi, E. Branchini, M. Brescia, J. Brinchmann, S. Camera, V. Capobianco, C. Carbone, V. F. Cardone, J. Carretero, S. Casas, M. Castellano, S. Cavuoti, A. Cimatti, G. Congedo, L. Conversi, Y. Copin, L. Corcione, F. Courbin , et al. (96 additional authors not shown)

Abstract: To obtain an accurate cosmological inference from upcoming weak lensing surveys such as the one conducted by Euclid, the shear measurement requires calibration using galaxy image simulations. We study the efficiency of different noise cancellation methods that aim at reducing the simulation volume required to reach a given precision in the shear measurement. Explicitly, we compared fit methods wit… ▽ More To obtain an accurate cosmological inference from upcoming weak lensing surveys such as the one conducted by Euclid, the shear measurement requires calibration using galaxy image simulations. We study the efficiency of different noise cancellation methods that aim at reducing the simulation volume required to reach a given precision in the shear measurement. Explicitly, we compared fit methods with different noise cancellations and a method based on responses. We used GalSim to simulate galaxies both on a grid and at random positions in larger scenes. Placing the galaxies at random positions requires their detection, which we performed with SExtractor. On the grid, we neglected the detection step and, therefore, the potential detection bias arising from it. The shear of the simulated images was measured with the fast moment-based method KSB, for which we note deviations from purely linear shear measurement biases. For the estimation of uncertainties, we used bootstrap** as an empirical method. We find that each method we studied on top of shape noise cancellation can further increase the efficiency of calibration simulations. The improvement depends on the considered shear amplitude range and the type of simulations (grid-based or random positions). The response method on a grid for small shears provides the biggest improvement. In the more realistic case of randomly positioned galaxies, we still find an improvement factor of 70 for small shears using the response method. Alternatively, the runtime can be lowered by a factor of 7 already using pixel noise cancellation on top of shape noise cancellation. Furthermore, we demonstrate that the efficiency of shape noise cancellation can be enhanced in the presence of blending if entire scenes are rotated instead of individual galaxies. △ Less

Submitted 16 January, 2024; originally announced January 2024.

Comments: Accepted by A&A. 24 pages, 15+7 figures, Euclid standard paper

Euclid preparation: TBD. The pre-launch Science Ground Segment simulation framework

Authors: Euclid Collaboration, S. Serrano, P. Hudelot, G. Seidel, J. E. Pollack, E. Jullo, F. Torradeflot, D. Benielli, R. Fahed, T. Auphan, J. Carretero, H. Aussel, P. Casenove, F. J. Castander, J. E. Davies, N. Fourmanoit, S. Huot, A. Kara, E. Keihanen, S. Kermiche, K. Okumura, J. Zoubian, A. Ealet, A. Boucaud, H. Bretonniere , et al. (251 additional authors not shown)

Abstract: The European Space Agency's Euclid mission is one of the upcoming generation of large-scale cosmology surveys, which will map the large-scale structure in the Universe with unprecedented precision. The development and validation of the SGS pipeline requires state-of-the-art simulations with a high level of complexity and accuracy that include subtle instrumental features not accounted for previous… ▽ More The European Space Agency's Euclid mission is one of the upcoming generation of large-scale cosmology surveys, which will map the large-scale structure in the Universe with unprecedented precision. The development and validation of the SGS pipeline requires state-of-the-art simulations with a high level of complexity and accuracy that include subtle instrumental features not accounted for previously as well as faster algorithms for the large-scale production of the expected Euclid data products. In this paper, we present the Euclid SGS simulation framework as applied in a large-scale end-to-end simulation exercise named Science Challenge 8. Our simulation pipeline enables the swift production of detailed image simulations for the construction and validation of the Euclid mission during its qualification phase and will serve as a reference throughout operations. Our end-to-end simulation framework starts with the production of a large cosmological N-body & mock galaxy catalogue simulation. We perform a selection of galaxies down to I_E=26 and 28 mag, respectively, for a Euclid Wide Survey spanning 165 deg^2 and a 1 deg^2 Euclid Deep Survey. We build realistic stellar density catalogues containing Milky Way-like stars down to H<26. Using the latest instrumental models for both the Euclid instruments and spacecraft as well as Euclid-like observing sequences, we emulate with high fidelity Euclid satellite imaging throughout the mission's lifetime. We present the SC8 data set consisting of overlap** visible and near-infrared Euclid Wide Survey and Euclid Deep Survey imaging and low-resolution spectroscopy along with ground-based. This extensive data set enables end-to-end testing of the entire ground segment data reduction and science analysis pipeline as well as the Euclid mission infrastructure, paving the way to future scientific and technical developments and enhancements. △ Less

Submitted 2 January, 2024; originally announced January 2024.

Comments: 38 pages, 25 figures, A&A submitted

A Survey on Multimodal Large Language Models for Autonomous Driving

Authors: Can Cui, Yunsheng Ma, Xu Cao, Wenqian Ye, Yang Zhou, Kaizhao Liang, **tai Chen, Juanwu Lu, Zichong Yang, Kuei-Da Liao, Tianren Gao, Erlong Li, Kun Tang, Zhipeng Cao, Tong Zhou, Ao Liu, Xinrui Yan, Shuqi Mei, Jianguo Cao, Ziran Wang, Chao Zheng

Abstract: With the emergence of Large Language Models (LLMs) and Vision Foundation Models (VFMs), multimodal AI systems benefiting from large models have the potential to equally perceive the real world, make decisions, and control tools as humans. In recent months, LLMs have shown widespread attention in autonomous driving and map systems. Despite its immense potential, there is still a lack of a comprehen… ▽ More With the emergence of Large Language Models (LLMs) and Vision Foundation Models (VFMs), multimodal AI systems benefiting from large models have the potential to equally perceive the real world, make decisions, and control tools as humans. In recent months, LLMs have shown widespread attention in autonomous driving and map systems. Despite its immense potential, there is still a lack of a comprehensive understanding of key challenges, opportunities, and future endeavors to apply in LLM driving systems. In this paper, we present a systematic investigation in this field. We first introduce the background of Multimodal Large Language Models (MLLMs), the multimodal models development using LLMs, and the history of autonomous driving. Then, we overview existing MLLM tools for driving, transportation, and map systems together with existing datasets and benchmarks. Moreover, we summarized the works in The 1st WACV Workshop on Large Language and Vision Models for Autonomous Driving (LLVM-AD), which is the first workshop of its kind regarding LLMs in autonomous driving. To further promote the development of this field, we also discuss several important problems regarding using MLLMs in autonomous driving systems that need to be solved by both academia and industry. △ Less

Submitted 20 November, 2023; originally announced November 2023.

Euclid preparation. Spectroscopy of active galactic nuclei with NISP

Authors: Euclid Collaboration, E. Lusso, S. Fotopoulou, M. Selwood, V. Allevato, G. Calderone, C. Mancini, M. Mignoli, M. Scodeggio, L. Bisigello, A. Feltre, F. Ricci, F. La Franca, D. Vergani, L. Gabarra, V. Le Brun, E. Maiorano, E. Palazzi, M. Moresco, G. Zamorani, G. Cresci, K. Jahnke, A. Humphrey, H. Landt, F. Mannucci , et al. (224 additional authors not shown)

Abstract: The statistical distribution and evolution of key properties (e.g. accretion rate, mass, or spin) of active galactic nuclei (AGN), remain an open debate in astrophysics. The ESA Euclid space mission, launched on July 1st 2023, promises a breakthrough in this field. We create detailed mock catalogues of AGN spectra, from the rest-frame near-infrared down to the ultraviolet, including emission lines… ▽ More The statistical distribution and evolution of key properties (e.g. accretion rate, mass, or spin) of active galactic nuclei (AGN), remain an open debate in astrophysics. The ESA Euclid space mission, launched on July 1st 2023, promises a breakthrough in this field. We create detailed mock catalogues of AGN spectra, from the rest-frame near-infrared down to the ultraviolet, including emission lines, to simulate what Euclid will observe for both obscured (type 2) and unobscured (type 1) AGN. We concentrate on the red grisms of the NISP instrument, which will be used for the wide-field survey, opening a new window for spectroscopic AGN studies in the near-infrared. We quantify the efficiency in the redshift determination as well as in retrieving the emission line flux of the H$α$+[NII] complex as Euclid is mainly focused on this emission line as it is expected to be the brightest one in the probed redshift range. Spectroscopic redshifts are measured for 83% of the simulated AGN in the interval where the H$α$+[NII] is visible (0.89<z<1.83 at a line flux $>2x10^{-16}$ erg s$^{-1}$ cm$^{-2}$, encompassing the peak of AGN activity at $z\simeq 1-1.5$) within the spectral coverage of the red grism. Outside this redshift range, the measurement efficiency decreases significantly. Overall, a spectroscopic redshift is correctly determined for ~90% of type 2 AGN down to an emission line flux of $3x10^{-16}$ erg s$^{-1}$ cm$^{-2}$, and for type 1 AGN down to $8.5x10^{-16}$ erg s$^{-1}$ cm$^{-2}$. Recovered black hole mass values show a small offset with respect to the input values ~10%, but the agreement is good overall. With such a high spectroscopic coverage at z<2, we will be able to measure AGN demography, scaling relations, and clustering from the epoch of the peak of AGN activity down to the present-day Universe for hundreds of thousand AGN with homogeneous spectroscopic information. △ Less

Submitted 15 January, 2024; v1 submitted 20 November, 2023; originally announced November 2023.

Comments: 29 pages, 23 figures. Submitted to A&A, revised version

Mean-field variational inference with the TAP free energy: Geometric and statistical properties in linear models

Authors: Michael Celentano, Zhou Fan, Licong Lin, Song Mei

Abstract: We study mean-field variational inference in a Bayesian linear model when the sample size n is comparable to the dimension p. In high dimensions, the common approach of minimizing a Kullback-Leibler divergence from the posterior distribution, or maximizing an evidence lower bound, may deviate from the true posterior mean and underestimate posterior uncertainty. We study instead minimization of the… ▽ More We study mean-field variational inference in a Bayesian linear model when the sample size n is comparable to the dimension p. In high dimensions, the common approach of minimizing a Kullback-Leibler divergence from the posterior distribution, or maximizing an evidence lower bound, may deviate from the true posterior mean and underestimate posterior uncertainty. We study instead minimization of the TAP free energy, showing in a high-dimensional asymptotic framework that it has a local minimizer which provides a consistent estimate of the posterior marginals and may be used for correctly calibrated posterior inference. Geometrically, we show that the landscape of the TAP free energy is strongly convex in an extensive neighborhood of this local minimizer, which under certain general conditions can be found by an Approximate Message Passing (AMP) algorithm. We then exhibit an efficient algorithm that linearly converges to the minimizer within this local neighborhood. In settings where it is conjectured that no efficient algorithm can find this local neighborhood, we prove analogous geometric properties for a local minimizer of the TAP free energy reachable by AMP, and show that posterior inference based on this minimizer remains correctly calibrated. △ Less

Submitted 14 November, 2023; originally announced November 2023.

Comments: 79 pages, 5 figures

Euclid Preparation. TBD. Impact of magnification on spectroscopic galaxy clustering

Authors: Euclid Collaboration, G. Jelic-Cizmek, F. Sorrenti, F. Lepori, C. Bonvin, S. Camera, F. J. Castander, R. Durrer, P. Fosalba, M. Kunz, L. Lombriser, I. Tutusaus, C. Viglione, Z. Sakr, N. Aghanim, A. Amara, S. Andreon, M. Baldi, S. Bardelli, C. Bodendorf, D. Bonino, E. Branchini, M. Brescia, J. Brinchmann, V. Capobianco , et al. (204 additional authors not shown)

Abstract: In this paper we investigate the impact of lensing magnification on the analysis of Euclid's spectroscopic survey, using the multipoles of the 2-point correlation function for galaxy clustering. We determine the impact of lensing magnification on cosmological constraints, and the expected shift in the best-fit parameters if magnification is ignored. We consider two cosmological analyses: i) a full… ▽ More In this paper we investigate the impact of lensing magnification on the analysis of Euclid's spectroscopic survey, using the multipoles of the 2-point correlation function for galaxy clustering. We determine the impact of lensing magnification on cosmological constraints, and the expected shift in the best-fit parameters if magnification is ignored. We consider two cosmological analyses: i) a full-shape analysis based on the $Λ$CDM model and its extension $w_0w_a$CDM and ii) a model-independent analysis that measures the growth rate of structure in each redshift bin. We adopt two complementary approaches in our forecast: the Fisher matrix formalism and the Markov chain Monte Carlo method. The fiducial values of the local count slope (or magnification bias), which regulates the amplitude of the lensing magnification, have been estimated from the Euclid Flagship simulations. We use linear perturbation theory and model the 2-point correlation function with the public code coffe. For a $Λ$CDM model, we find that the estimation of cosmological parameters is biased at the level of 0.4-0.7 standard deviations, while for a $w_0w_a$CDM dynamical dark energy model, lensing magnification has a somewhat smaller impact, with shifts below 0.5 standard deviations. In a model-independent analysis aiming to measure the growth rate of structure, we find that the estimation of the growth rate is biased by up to $1.2$ standard deviations in the highest redshift bin. As a result, lensing magnification cannot be neglected in the spectroscopic survey, especially if we want to determine the growth factor, one of the most promising ways to test general relativity with Euclid. We also find that, by including lensing magnification with a simple template, this shift can be almost entirely eliminated with minimal computational overhead. △ Less

Submitted 6 November, 2023; originally announced November 2023.

Comments: 23 pages, 14 figures

RiskQ: Risk-sensitive Multi-Agent Reinforcement Learning Value Factorization

Authors: Siqi Shen, Chennan Ma, Chao Li, Weiquan Liu, Yongquan Fu, Songzhu Mei, Xinwang Liu, Cheng Wang

Abstract: Multi-agent systems are characterized by environmental uncertainty, varying policies of agents, and partial observability, which result in significant risks. In the context of Multi-Agent Reinforcement Learning (MARL), learning coordinated and decentralized policies that are sensitive to risk is challenging. To formulate the coordination requirements in risk-sensitive MARL, we introduce the Risk-s… ▽ More Multi-agent systems are characterized by environmental uncertainty, varying policies of agents, and partial observability, which result in significant risks. In the context of Multi-Agent Reinforcement Learning (MARL), learning coordinated and decentralized policies that are sensitive to risk is challenging. To formulate the coordination requirements in risk-sensitive MARL, we introduce the Risk-sensitive Individual-Global-Max (RIGM) principle as a generalization of the Individual-Global-Max (IGM) and Distributional IGM (DIGM) principles. This principle requires that the collection of risk-sensitive action selections of each agent should be equivalent to the risk-sensitive action selection of the central policy. Current MARL value factorization methods do not satisfy the RIGM principle for common risk metrics such as the Value at Risk (VaR) metric or distorted risk measurements. Therefore, we propose RiskQ to address this limitation, which models the joint return distribution by modeling quantiles of it as weighted quantile mixtures of per-agent return distribution utilities. RiskQ satisfies the RIGM principle for the VaR and distorted risk metrics. We show that RiskQ can obtain promising performance through extensive experiments. The source code of RiskQ is available in https://github.com/xmu-rl-3dv/RiskQ. △ Less

Submitted 21 March, 2024; v1 submitted 3 November, 2023; originally announced November 2023.

Comments: Accepted at NeurIPS 2023