LAVA: Explainability for Unsupervised Latent Embeddings
Extracted source text · arXiv 2509.21149
\documentclass{article}
% if you need to pass options to natbib, use, e.g.:
% \PassOptionsToPackage{numbers, compress}{natbib}
% before loading neurips_2025
% ready for submission
% \usepackage[nonatbib]{neurips_2025}
% to compile a preprint version, e.g., for submission to arXiv, add add the
% [preprint] option:
\usepackage[preprint, nonatbib]{neurips_2025}
% to compile a camera-ready version, add the [final] option, e.g.:
% \usepackage[final]{neurips_2025}
% to avoid loading the natbib package, add option nonatbib:
% \usepackage[nonatbib]{neurips_2025}
\usepackage[utf8]{inputenc} % allow utf-8 input
\usepackage[T1]{fontenc} % use 8-bit T1 fonts
\usepackage{hyperref} % hyperlinks
\usepackage{url} % simple URL typesetting
\usepackage{booktabs} % professional-quality tables
\usepackage{amsfonts} % blackboard math symbols
\usepackage{nicefrac} % compact symbols for 1/2, etc.
\usepackage{microtype} % microtypography
\usepackage{xcolor} % colors
% Extra packages
\usepackage{graphicx}
\usepackage{caption}
\usepackage{subcaption}
\usepackage{bbm}
\usepackage{amsmath}
\usepackage{algorithm}
\usepackage{algpseudocode}
\usepackage{wrapfig}
\usepackage[citestyle=numeric-comp, sorting=none]{biblatex}
\bibliography{refs}
\title{\Large LAVA: Explainability for Unsupervised Latent Embeddings}
% The \author macro works with any number of authors. There are two commands
% used to separate the names and addresses of multiple authors: \And and \AND.
%
% Using \And between authors leaves it to LaTeX to determine where to break the
% lines. Using \AND forces a line break at that point. So, if LaTeX puts 3 of 4
% authors names on the first line, and the last on the second line, try using
% \AND instead of \And before the third author name.
% Hidden in submission setting.
\author{%
Ivan Stresec\\
Delft University of Technology\\
The Netherlands\\
\texttt{i.stresec@tudelft.nl} \\
\And
Joana P. Gonçalves\\
Delft University of Technology\\
The Netherlands\\
\texttt{joana.goncalves@tudelft.nl} \\
% \AND
% Coauthor \\
% Affiliation \\
% Address \\
% \texttt{email} \\
% \And
% Coauthor \\
% Affiliation \\
% Address \\
% \texttt{email} \\
% \And
% Coauthor \\
% Affiliation \\
% Address \\
% \texttt{email} \\
}
\begin{document}
% Guidelines (https://neurips.cc/Conferences/2025/CallForPapers):
% The authors may optionally choose to include some or all of the technical appendices in the same PDF above. But those included parts cannot be changed after the full submission deadline.
% The main text of a submitted paper is limited to nine content pages, including all figures and tables. Additional pages containing references, checklist, and the optional technical appendices do not count as content pages. If your submission is accepted, you will be allowed an additional content page for the camera-ready version. The maximum file size for a main paper submission is 50MB.
% You must format your submission using the NeurIPS 2025 LaTeX style file, which includes a "preprint" option for non-anonymous preprints posted online. Submissions that violate the NeurIPS style (e.g., by decreasing margins or font sizes) or page limits may be rejected without further review. Papers may also be rejected without consideration of their merits if they fail to meet the submission requirements, as described in this document.
\maketitle
\begin{abstract}
Unsupervised black-box models can be drivers of scientific discovery, but remain difficult to interpret. Crucially, discovery hinges on understanding the model output, which is often a multi-dimensional latent embedding rather than a well-defined target. While explainability for supervised learning usually seeks to uncover how input features are used to predict a target, its unsupervised counterpart should relate input features to the structure of the learned latent space. Adaptations of supervised model explainability for unsupervised learning provide either single-sample or dataset-wide summary explanations. However, without automated strategies of relating similar samples to one another guided by their latent proximity, explanations remain either too fine-grained or too reductive to be meaningful. This is especially relevant for manifold learning methods that produce no mapping function, leaving us only with the relative spatial organization of their embeddings. We introduce Locality-Aware Variable Associations (LAVA), a post-hoc model-agnostic method designed to explain local embedding organization through its relationship with the input features. To achieve this, LAVA represents the latent space as a series of localities (neighborhoods) described in terms of correlations between the original features, and then reveals reoccurring patterns of correlations across the entire latent space. Based on UMAP embeddings of MNIST and a single-cell kidney dataset, we show that LAVA captures relevant feature associations, with visually and biologically relevant local patterns shared among seemingly distant regions of the latent spaces.
\end{abstract}
\section{Introduction}
% Pragmatically,
A pragmatic explanation can simply be defined as an answer to the question ``why?''~\cite{fraassen_pragmatic_1988}. Traditional models, like Newton's law of gravitation, constitute pragmatic explanations as they allow reasoning about observable phenomena through rigorous mathematical description. Similarly, stochastic phenomena that lend themselves well to statistical modeling, including linear regression, are explainable through probabilistic reasoning.
%Pragmatic theory of scientific explanation defines an explanation to simply be an answer to the question ``why?'' \cite{fraassen_pragmatic_1988}. More traditional models, such as Newton's law of gravitation or Einstein's general relativity, are in themselves pragmatic explanations as they allow us to reason about observable phenomena at some level, e.g., answering the questions why planets move in a certain way through mathematically relating their movement to their mass, the distances between them, etc. Importantly, they are also reasonably consistent with existing observation and allow for new prediction based on induction. More stochastic phenomena lend themselves naturally to statistical modeling, which allows us to reason about phenomena probabilistically, rather than deterministically. While less direct, the statistical framework still allows for reasoning about the modeled phenomena, e.g., a regression model might tell us that some amount of exposure to smoking will increase the probability of lung cancer by some amount with some certainty.
%
For more complex problems such as facial recognition or protein structure prediction, expert-led modeling is superseded by machine learning (ML), where flexible model architectures and automated end-to-end optimization algorithms take center stage. ML has seen considerable progress and success in leveraging high-dimensional data for scientific discovery across fields like chemistry, mathematics, and biology~\cite{jumper_highly_2021, davies_advancing_2021, movva_deciphering_2019, ching_opportunities_2018}. However, even when ML models make reliable predictions or reflect observed phenomena, reasoning about their decisions is notoriously difficult as many ML models are ``black boxes'': even with full decomposibility, the complexity of the data and operations required to produce an output often exceeds what is practically comprehensible \cite{lipton_mythos_2017, humphreys_philosophical_2009, beisbart_philosophy_2022}. Limited insight into model behavior is a major barrier to wider adoption of ML for decision making, especially in critical areas such as healthcare and aviation~\cite{rudin_stop_2019, murdoch_definitions_2019, ching_opportunities_2018, wang_scientific_2023}. To improve the understanding of ML, the community uses either intrinsically interpretable but restrictive models, or \textit{post-hoc} explainability methods that enable interpretation of black-box models~\cite{rudin_stop_2019, higgins_towards_2018, scholkopf_causality_2019, murdoch_definitions_2019, molnar2022}.
%When faced with less straightforward problems and more complex data -- take, as example, facial recognition and text translation -- the statistical framework is superseded by statistical, or machine learning (ML). ML uses large, flexible models and replaces unattendable manual model development with automatic end-to-end optimization algorithms (e.g., artificial neural networks and backpropagation). It has seen considerable progress in recent times and, despite being mainly associative rather than causally structured \cite{scholkopf_causality_2019}, it can leverage large amounts of data for accurate prediction and scientific discovery in fields such as chemistry, mathematics, and biology \cite{jumper_highly_2021, davies_advancing_2021, movva_deciphering_2019, ching_opportunities_2018}. However, even if some ML models accurately reflect observed phenomena and seem to produce reliable predictions, reasoning about their decision-making is notoriously difficult. This difficulty arises due to the fact that most ML models are so-called ``black-boxes''. This is not to say that the inner workings of these models are at fault: even with full algorithmic transparency -- e.g., understanding each computational step in a neural network -- the sheer dimensionality of the data or number of computational steps required to produce an output is usually too large to be practically comprehensible \cite{lipton_mythos_2017, humphreys_philosophical_2009, beisbart_philosophy_2022}. This, in effect, means that we lose the explainable component of classical and statistical models: we can no longer answer the question ``why?'' through understandable mathematical relations between observable phenomena. This severely impairs our ability to understand behavior of models and therefore puts into question their reliability, which is a major limitation standing in the way of wider application for science and critical decision making, e.g., in healthcare \cite{rudin_stop_2019, murdoch_definitions_2019, ching_opportunities_2018, wang_scientific_2023}. As a response, parts of the community are working on more restrictive, but simpler and intrinsically interpretable models, while others are developing explainability methods whose aim is to make existing models interpretable \textit{post hoc}, i.e., after they have been trained, and therefore without compromising their flexibility \cite{rudin_stop_2019, higgins_towards_2018, scholkopf_causality_2019, murdoch_definitions_2019, molnar2022}. It remains unclear whether most stochastic and highly-dimensional phenomena can be reduced into models of the former, warranting both research directions. We focus on the latter.
% Interpretability might broadly be defined as ``the extraction of relevant knowledge from an ML model concerning relationships either contained in data or learned by the model'' \cite{murdoch_definitions_2019}.
The increasing popularity and complexity of black-box ML poses challenges to existing \textit{post-hoc} explainability methods, exposing their shortcomings and creating a need for new solutions. At its core, \textit{post-hoc} explainability aims to enable reasoning about the output of the model in terms of its treatment of the original input data. %enhance the understanding of a model by identifying the relationships it leverages to produce its output based on the input data.
This information enables cross-referencing of model behavior with domain knowledge for further verification and assessment of model reliability, as well as mitigation of unwanted biases.
%
Existing explainability methods cover a wide range of approaches, including feature or sample importance, anchors, counterfactual explanations, among others~\cite{molnar2022}. %Most focus on feature importance, seeking to quantify the influence of input variables on model performance or output: examples range from model-agnostic methods such as LIME and SHAP~\cite{ribeiro_why_2016, lundberg_unified_2017} to model-specific approaches including layer-wise propagation and integrated gradients for deep learning models~\cite{sundararajan_axiomatic_2017, montavon_layer-wise_2019}.
However, most have been developed to explain supervised learning models, whose output tends to be a well-defined target label or quantity. This ostensibly ignores unsupervised black-box learning strategies, which are designed to reveal latent structure with limited prior knowledge, and thus also contribute meaningfully to scientific discovery. Indeed, latent embeddings based on autoencoders, transformers, and diffusion models have shown effectiveness in various tasks \cite{brown_language_2020, ramesh_zero-shot_2021, makrodimitris_-depth_2024, kobak_art_2019}, and serve as the basis of foundation models \cite{bommasani_opportunities_2022}. Similarly, manifold learning is prominently used in bioinformatics for data exploration, trajectory inference, cell type annotation, spatial domain identification, and multi-omics integration \cite{kobak_art_2019, brbic_annotation_2022, saelens_comparison_2019, wolf_paga_2019, haviv_covariance_2024}.
Crucially, most unsupervised black-box models output multi-dimensional latent embeddings. Relating such dimensions to the input data is less straightforward, as the axes of the learned latent space do not correspond to known quantities and are therefore difficult to interpret~\cite{crabbe_label-free_2022}. %
%\textbf{Explainability.} We define explainability as \textit{post hoc} methods for creating summarizations of black-box ML models that allow us to reason about the modeled phenomena, with two instrumental goals: (1)~cross-referencing model behavior with domain knowledge to assess model reliability and mitigate unwanted bias; (2)~understanding the underlying data structure and aid in scientific discovery.
% (2) might ultimately subsume (1).
%Most existing explainability methods are based on feature importance scores, which, not unlike traditional models, attempt to enable reasoning through quantifying the influence of input variables on the model's output. Well-known examples include model-agnostic methods such as LIME and SHAP \cite{ribeiro_why_2016, lundberg_unified_2017}, as well as model-specific approaches, e.g., the \textit{layer-wise propagation} (LRP) and integrated gradients methods for deep learning models \cite{sundararajan_axiomatic_2017, montavon_layer-wise_2019}. Other approaches include sample-level importance measures, anchors, counterfactual explanations, and more \cite{molnar2022}. However, the overwhelming majority of these methods are not applicable to unsupervised learning.
%
% There's a 'flow break' between these two paragraphs. Failed to incorporate manifold learning into the line of reasoning without first digressing from explainability. I synthesize after two paragraphs.
%
%\textbf{Manifold learning.} This paper is specifically about explainability for manifold learning, which are unsupervised, non-linear dimensionality reduction ML methods aimed at retaining local structure of high-dimensional data in a lower-dimensional latent space. While definitions vary, the majority of these methods are based on preservation of local neighborhoods, e.g., the widely used t-SNE and UMAP methods \cite{meila_manifold_2024, maaten_visualizing_2008, mcinnes_umap_2020}. Manifold learning is used primarily for visualization, and in some cases for downstream analysis. Use is perhaps most prominent in the field of bioinformatics, where these methods are used for data exploration, trajectory inference, and for analysis of more specific latent representations designed for tasks such as cell-type annotation and multi-omics integration \cite{kobak_art_2019, brbic_annotation_2022, saelens_comparison_2019, wolf_paga_2019, haviv_covariance_2024}.
%
%\textbf{Manifold learning as latent space generation.} In the context of unsupervised methods, manifold learning can be considered a method of abstraction, aimed at revealing properties of the data not easily discernible by humans \cite{ohara_explainable_2020, watson_philosophy_2023}. However, as a non-linear method that generates latent embeddings, these uncovered properties are not explicit, but encoded in the spatial organization of data in the latent space. Latent embeddings based on architectures such as autoencoders, transformers, and diffusion models were shown to be effective in various settings \cite{brown_language_2020, ramesh_zero-shot_2021, makrodimitris_-depth_2024, kobak_art_2019}, and also serve as the basis of foundation models \cite{bommasani_opportunities_2022}. Whether supervised, self-supervised, or unsupervised, reasoning about the extracted embeddings is impeded by the black-box nature of ML. Analogously to supervised settings, while simpler linear methods, such as principal component analysis (PCA), might produce interpretable and independent latent dimensions -- at least for low-dimensional data --, non-linear ML methods used on high-dimensional data offer little in terms of explanation of underlying phenomena.
%
Approaches for disentangled representations have shown mixed results, %, and might altogether be impossible without supervision based on prior knowledge \cite{crabbe_label-free_2022, locatello_sober_2020},
suggesting that latent dimensions cannot be explained independently from one another~\cite{crabbe_label-free_2022, locatello_sober_2020}. As a result, it might be necessary for explainability of unsupervised black-box models to focus on relationships between input data and the relative spatial organization of the embeddings. Moreover, many manifold learning methods only produce representations of the samples in the learned latent space, without an underlying mapping function to embed new data \cite{murphy_probabilistic_2022}. This means that all information is contained exclusively within the embeddings, making the link between latent organization and original data crucial for reasoning about the underlying model.
% For latent embedding methods, explainability should help us reason about how the data is organized in the latent space.
%\textbf{Extending explainability to manifold learning.} As an extension of unsupervised methods, explainability of manifold learning should help further elucidate uncovered properties of the data, as captured by the model \cite{watson_philosophy_2023}. As for latent embedding methods, explainability should help us reason about the data how it is organized in the latent space. For latent representations, the unsupervised, ``label-free'' setting implies some mapping $\mathcal{X} \rightarrow \mathcal{H}$, where $\mathcal{X}$ is the input feature space and $\mathcal{H}$ is the latent feature space. Unlike the input space or labeled output features in supervised methods, the axes of the latent do not correspond to known quantities, further increasing difficulty of interpretation \cite{crabbe_label-free_2022}. Moreover, disentangled representations have shown mixed results, and might altogether be impossible without supervision based on prior knowledge \cite{crabbe_label-free_2022, locatello_sober_2020}, meaning that latent features cannot be explained independently from one another. Last but not least, most manifold learning methods are also parameterless: they fit no parameters and produce no function that can generalize to unseen data \cite{murphy_probabilistic_2022}. Distinctly, this means that all information is contained exclusively in the spatial organization of samples in the latent space. All things considered, explainability for manifold learning, without supervised input, should enable reasoning through revealing relationships between input features and the relative spatial organization of the embeddings alone.
Existing literature on explainability of unsupervised black-box latent embeddings is limited. Most notably, \cite{crabbe_label-free_2022} introduce a framework adapting feature and sample importance methodology developed for supervised models to the unsupervised setting. This contribution importantly enables explanations for unsupervised models using a wide range of explainability methods. However, available methods yield either individual sample or dataset-wide summary explanations, which ignore the inherent organization of the latent embeddings and are likely too fine-grained or too global to meaningfully understand the underlying model. This is especially relevant as many black-box models are non-linear and seek to capture local structure in the original high-dimensional data. In fact, the popular t-SNE and UMAP manifold learning algorithms ~\cite{meila_manifold_2024, maaten_visualizing_2008, mcinnes_umap_2020} explicitly aim to preserve local sample neighborhoods of the input space in a lower-dimensional latent space. We therefore argue that effective explainability of latent embeddings requires some strategy to relate samples to one another based on their organization or proximity in the latent space. Manifold learning methods specifically have been characterized in terms of neighborhood retention \cite{han_enhance_2022}, and further analyzed to recommend ways of setting hyperparameters \cite{becht_dimensionality_2019, kobak_art_2019, wang_understanding_2021, xia_statistical_2024}. While these studies offer insight into these methods, they do not provide information on how the embeddings relate to the the original data. More manual approaches can relate spatial organization to original features \cite{liu_latent_2019}, but rely on prior knowledge, metadata, or target features of interest, and are likely infeasible for higher-dimensional data.
%\textbf{Related work.} Existing literature on explaining unsupervised latent embeddings is limited. \cite{crabbe_label-free_2022} introduce a framework for adapting local importance scores for supervised methods to unsupervised latent spaces. However, without relevant ways of relating larger groups of samples to one another, the local explanations are too fine-grained for understanding data structure or properties more globally. Furthermore, the framework is not applicable to the parameterless manifold learning methods. \cite{han_enhance_2022} attempt to better understand embeddings created by manifold learning methods by characterizing them in terms of neighborhood retention, i.e., which percentage of neighbors from the original feature space is retained in the latent space. Other work similarly analyzes behavior of manifold learning embeddings and recommend ways of setting hyperparameters \cite{becht_dimensionality_2019, kobak_art_2019, wang_understanding_2021, xia_statistical_2024}. While these works provides insight into inner workings of manifold learning methods and producing domain-relevant visualization, they gives us no information about how the embeddings themselves relate to the original features of the data used to create them. More manual approaches, such as \cite{liu_latent_2019}, can relate spatial organization to input features, but rely heavily on prior knowledge, metadata, or target features of interest, and are likely infeasible for higher-dimensional data. As an alternative to explainability for latent spaces, there also exists a body of work in creating disentangled representation that aim to produce interpretable latent features such as those of simpler, linear models \cite{higgins_beta-vae_2017, chen_isolating_2019, sarhan_learning_2019}, but whose limitations we touched upon in the paragraph above \cite{locatello_sober_2020, crabbe_label-free_2022}.
% Refer to overview figure in contribution, or wait until methodology?
In this work, we propose Locality-Aware Variable Associations (LAVA), a model-agnostic method to explain learned latent embeddings through relationships between the input features and the local latent spatial organization. To explain local structure, LAVA creates explanations based on localities: neighborhoods of sample embeddings across the latent space. Each latent locality is linked to the original data through a representation comprising all pairwise correlations between the original features, considering only the original samples belonging to that locality's neighborhood. To reveal the consistency of local relationships between localities throughout the latent space, LAVA identifies modules of reoccurring subpatterns of feature correlations across localities. Experiments with LAVA reveal that neighborhoods of embeddings across a latent space can show distinct correlation patterns but also share subpatterns of correlation, and demonstrate that LAVA modules capture similar subpatterns between localities. We use LAVA to explain UMAP embeddings of both MNIST and single-cell kidney datasets, and showcase its ability to identify visually and biologically relevant modules of pixels and gene expression correlation, respectively.
%\textbf{Contribution.} In this work, we propose the Locality-Aware Variable Associations (LAVA) method, an approach to explaining manifold learning embeddings through the linking of input features and spatial organization of latent embeddings. As manifold learning focuses on retention of local structure, and we choose to remain agnostic towards specific targets of interest, LAVA focuses on creating explanations based on local spatial organization, i.e., neighborhoods. LAVA represents latent embeddings as a limited subset of all possible latent neighborhoods, called localities. Each locality is put into relation with the original data by calculating pairwise correlations between the original features using samples in each locality's neighborhood. LAVA then extracts globally reoccurring subpatterns of these correlations into a smaller number of modules. Therefore, each locality is linked to the input space through correlations between input features, and is further related to other localities through modules. To validate our approach, we experimentally show that neighborhoods of embeddings across a latent space can have highly distinct correlation patterns, but can also share subpatterns of correlation. We then demonstrate how LAVA's modules can uncover and extract the similar subpatterns between the localities, and show their desirable properties. We finally use LAVA to explain a UMAP of single-cell kidney data, and showcase its ability to extract biologically-relevant modules of gene expression correlation.
\section{Methodology}
\label{sec:methods}
The LAVA method consists of three steps: (1) locality definition, (2) locality representation, %association estimation,
and (3) module extraction (Figure \ref{fig:method_overview}). %The first two steps create a reduced representation of the embeddings based on feature-to-feature correlations of the original data, linking the input and the latent space, while the third step relates these representations with a smaller number of correlation subpatterns, and in so doing uncovers reoccurring structure throughout the latent space. We expand on each of the three steps below.
The first two steps create a reduced representation of the embeddings to explain, linking the latent and original spaces through local latent neighborhoods called localities, summarized by correlations of the original features. The third step uncovers structure preserved throughout the latent space, in the form of correlation subpatterns reoccurring across localities.
\begin{figure}[h]
\centering
\includegraphics[width=\linewidth]{figures/method_overview.pdf}
\caption{\textbf{LAVA method overview}. \textbf{a}, LAVA explains latent embeddings of a dataset (example UMAP embeddings of MNIST). \textbf{b}, Based on a neighborhood size hyperparameter $k$, LAVA represents the latent space as a series of localities: overlapping neighborhoods centered around latent points called probes. \textbf{c}, For each locality, LAVA calculates feature-to-feature correlations using the original samples of that locality (top right, locality correlations; bottom right, heatmap showing the sum of correlations per pixel, %highlighting features or pixels contributing to a large number of correlations,
with added lines connecting correlated pixels). %showing stronger correlations.
\textbf{d}, LAVA identifies modules yielding shared subpatterns of correlation across localities. %(Section \ref{sec:module_extraction}).
%Modules relate localities through shared patterns, regardless of how distant the localities are in the latent space.
}
%\caption{\textbf{LAVA framework overview}. \textbf{a}, As input, LAVA takes latent embeddings of a dataset. In this example, UMAP embeddings of the MNIST dataset. \textbf{b}, Based on the neighborhood size hyperparameter, LAVA represents a latent space as a series of localities: overlapping neighborhoods centered around points in the latent space called probes. \textbf{c}, For each locality, LAVA calculates feature-to-feature correlations using original data its embeddings represent. Feature-to-feature correlations of the MNIST dataset are visualized with a pixel heatmap, highlighting features that participate in a large number of correlations, with added lines showing the stronger correlations. \textbf{d}, LAVA extracts common subpatterns of correlation – “modules” – throughout the different localities of a latent space (see Section \ref{sec:module_extraction}). Modules relate localities in terms of their shared feature-to-feature correlations, regardless of the distances between them.}
\label{fig:method_overview}
\end{figure}
%\subsection{Locality Definition and Representation}
\subsection{Locality Definition}
To reflect the local structure of the input latent sample embeddings, LAVA uses a smaller number of localities centered around probe points (not samples) that are spread across the latent space (Figure~\ref{fig:method_overview}b). The locality centered at probe $p$ is then the $n$-sized Euclidean neighborhood containing the $n$ neighbor samples nearest to $p$ in the latent space. LAVA defines the number of localities $\ell \leq E$ as $\ell = E \times o/n$, based on the number of input embeddings $E$ and two hyperparameters: the neighborhood size $n$, and a factor $o$ controlling the overlap between localities (Appendix~\ref{app:locality_definition}). %The number of localities $N \leq E$ is given by $N = E \times c/k$ (Appendix \ref{app:locality_definition}).
%To create a representation of embeddings in the latent space, we use a smaller number of localities, which are $k$-sized Euclidean neighborhoods given hyperparameter $k$ (choice of $k$ in Appendix \ref{app:hyperparameter_k}). Localities are centered around probes: points spread across the latent embedding space, not tied to specific samples (Figure \ref{fig:method_overview}b).
% Localities can be thought of as a reduced representation in which each sample in the latent space is represented by its $k$-sized neighborhood.
%The locality for probe $i$ is the neighborhood of the $k$ nearest samples to $i$, using Euclidean distance in latent space.
%Given a probe $i$, a locality is simply the neighborhood of the $k$ nearest samples around it, defined by the Euclidean distance between samples.
% The reduced representation using localities reduces computation and makes interpretation more manageable.
\textbf{Locality placement.}
% To produce localities that approximate a representation in which each sample is represented by its $k$-sized neighborhood,
LAVA determines the placement of localities by optimizing locality in-degree centrality towards neighborhood in-degree centrality. In other words, by making the number of probe-based localities including a sample as a neighbor approximate, in relative terms, the number of $n$-neighborhoods including a sample as a neighbor out of all sample-based $n$-sized neighborhoods (Figures~\ref{fig:mnist_probes} and \ref{fig:kpmp_probes}).
%LAVA determines the placement of localities such that each sample contributes as a neighbor to approximately as many probe-based localities approximates the number of $k$-neighborhoods that would include it if all sample-based $k$-neighborhoods were considered instead (Figure \ref{fig:probe_placement}a). This is done by optimizing locality in-degree centrality, here termed contribution, towards neighborhood in-degree centrality.
%We determine localities with the underlying idea that the relative contributions of samples to localities is approximately equal to their contribution to all $k$-sized neighborhoods (Figure \ref{fig:probe_placement}a). We do this by approximating relative in-degree centrality. If we create a graph with directed edges from each sample to its $k$ nearest neighbors, the in-degree centrality of a sample (or number of incoming edges), denotes the number of $k$-sized neighborhoods including that sample. We define contribution of a sample to localities in the equivalent way, but we look only at $k$-sized neighborhoods around probes rather than samples of a dataset. In the extreme case in which the number of localities would be equal to the number of samples, localities would correspond exactly to the samples' neighborhoods. %The number of localities is chosen based on the size of the dataset, $k$, and another hyperparameter $c$ (Appendix \ref{app:locality_definition}).
%
%\textbf{Optimization.}
Locality placement is optimized using weighted $k$-means clustering in combination with the DIRECT optimization algorithm~\cite{macqueen_methods_1967, jones_lipschitzian_1993}: the goal is to find the locations of the $\ell$ probes as cluster centers in $k$-means, with $k=\ell$, around which the $\ell$ localities will be formed. %For clarity in notation, we refer to the $k$-means algorithm as $N$-means, where $N$ is the number of localities (and probes), while $k$ denotes our previous neighborhood size hyperparameter.
%We first estimate the centrality defined above for all samples. We also calculate the average distances of the $k$ nearest neighbors for each sample. Then, e define the following sample weighing scheme:
Clustering is performed using the following sample weighting scheme:
\begin{equation}
\centering
w_i = \left(\frac{in\_neighborhood_i}{E}\right)^{\alpha} \times \left(\frac{1}{\bar{d}_i^n} \right)^{\beta},
\label{eq:weighing_scheme}
\end{equation}
where $w_i$ is the weight of sample $i$, $in\_neighborhood_i$ is the in-degree centrality of sample $i$ using sample-based $n$-neighborhoods, $\bar{d}_i^n$ is the average distance from sample $i$ to its $n$ nearest neighbors, and $\alpha$ and $\beta$ are parameters optimized using the DIRECT algorithm (Appendix~\ref{app:locality_definition}). We define the cost function for DIRECT as the Manhattan distance between the neighborhood and locality in-degree centralities of each sample, as follows:
\begin{equation}
\centering
\mathcal{L}(\alpha, \beta) = \sum_{i=1}^{E}\left|\frac{in\_neighborhood_i}{E} - \frac{in\_locality_{i,\alpha, \beta}}{\ell}\right|,
\label{eq:direct_loss}
\end{equation}
where $in\_locality_{i, \alpha, \beta}$ is the number of localities around the resulting $\ell$ cluster centers that include $i$ as a neighbor. %, when samples are weighed according to parameters $\alpha$ and $\beta$. The resulting placement of probes will therefore make the contribution of samples to localities as similar as possible to their centrality.
Implementation details and pseudocode can be found in Appendix \ref{app:locality_definition}.
%\subsection{Association estimation}
\subsection{Locality Representation}
After defining localities, LAVA links the local structure of the latent space to the original data. This is achieved by representing each locality through pairwise associations between features, using only the samples within that locality in their original feature space.
%In step (2), we want to estimate associations between the original variables for each of the localities from step (1). The key idea behind this step is linking the latent space to features of the original, input dataset.
% Representing local parts of the latent space through feature-to-feature associations of the original data capitalizes on the idea of Simpson's paradox: grouping data differently can lead to observation of different associative trends.
%The locality-based representation groups the data according to its latent spatial organization, meaning that pairwise association of variables is observed through the lens of the underlying model. Ideally, for each latent locality, we want to quantify to which extent any two original features are associated to one another.
In this version of LAVA, %We approximate this by calculating the
feature association is defined as the absolute value of the Spearman correlation coefficient, capturing the strength of monotone association between features as values in $[0, 1]$ (Figure~\ref{fig:method_overview}c).
% \begin{equation}
% \centering
% r_{ijl} = | \frac{\text{cov}(R[X_j][X_l])}{\sigma_{R[x_j]} \; \sigma_{R[X_l]}} |
% \end{equation}
% where $r_ijl$ is the correlation for locality $i$ between feature $j$ and $l$, and $R$ is the rank function between... Covariance and standard deviation are estimated using the $k$ samples in the neighborhood.
Hence, the representation of each locality is a vector of $D \choose 2$ pairwise correlations for an original dataset with $D$ features.
%Since the number of pairwise correlations per locality is $D \choose 2$ (every pair of the $D$ features of an input dataset).
%, corresponding to the upper-triangle of a correlation matrix between the original features, without its diagonal.
%Accordingly, we represent a locality's correlations using a vector of size $D \choose 2$.
Unlike Pearson correlations, Spearman correlations are not scale dependent and thus more flexible in the type of association they capture, while remaining computationally inexpensive and interpretable downstream. Individual correlations are filtered (set to $0$) if one of the original features has the same value in $>75\%$ of the neighborhood (Appendix~\ref{app:calculating_correlations}). %See Appendix \ref{app:calculating_correlations} for more details.
% We use absolute Spearman correlations as a proxy for variable association, and we use the terms correlations and associations interchangeably in the remainder of the work.
\subsection{Module Extraction}
\label{sec:module_extraction}
Finally, to reveal local relations preserved throughout the latent space, LAVA identifies modules of reoccurring feature association subpatterns across localities (Figure~\ref{fig:module_extraction}).
%In step (3), we want to reveal reoccurring subpatterns to help relate localities across the latent space to one another, and therefore reason more globally about the embeddings. LAVA does this through module extraction (Figure \ref{fig:module_extraction}). Modules are optimized to be subpatterns of feature-to-feature associations observed in a larger number of localities.
%
%\textbf{Properties.} We want modules to adhere to two properties:
Modules adhere to two properties: (1) modules capture reoccurring rather than average patterns across localities, since modules based on averages of localities would not be accurate representations of correlations observed at each locality individually; %as the latter would not be accurate representations of correlations in localities individually; %since if a module results from averaging its presence is not informative of the true correlations present in some locality;
(2) %more than one
modules can be co-present in the same locality, allowing decomposition of the locality pattern of correlation into subpatterns. %co-occurrence even when subpatterns occur in different subsets of localities. %(1) is essential because if a module is a result of averaging rather than extraction of reoccurring subpatterns, then the presence of a module is not informative of the true correlations present in some locality. (2) simply means that we want to allow fro the possibility of more subpatterns of correlation to be present at the same locality, even when these subpatterns might occur in a different subsets of localities.
\textbf{Extraction.}
Modules are identified based on the matrix of locality representations $\boldsymbol{C}$, with rows denoting the $\ell$ localities and columns representing the ${D \choose 2}$ pairwise correlations. To identify modules, we propose the Association Matrix Factorization (AMF) method, which factorizes a matrix like $\boldsymbol{C}$ into two: module matrix $\boldsymbol{M}$ and presence matrix $\boldsymbol{P}$. The module matrix $\boldsymbol{M}$ is of size $M \times {D \choose 2}$, where each row represents one of $M$ modules, columns denote correlations, and each row vector expresses a subpattern of correlations for the corresponding module. The presence matrix $\boldsymbol{P}$ is of size $\ell \times M$, with each entry quantifying the presence of one of the $M$ modules (or its subpattern) in one of the $\ell$ localities. Both presence and module matrix entries are restricted to real values in $[0, 1]$, and they reconstruct the locality correlations using the maximum formulation described below.
%To extract the modules, we first represent localities as matrix $\boldsymbol{C}$, of dimensionality $\ell \times {D \choose 2}$, in which each row represents one of $\ell$ localities, and each column is one of the pair-wise correlations between the $D$ features of the original dataset. We then apply a factorization method we call Association Matrix Factorization (AMF), which factorizes matrix $C$ into two matrices: the module matrix and the presence matrix. Like the correlations of a locality, each module is a vector of $D \choose 2$ values in the $[0, 1]$ range, where $D$ is the dimensionality of the original dataset. The modules matrix $M$ is of size $L \times {D \choose 2}$, where each row represent one module and columns are correlations. Each module has a corresponding $N$-sized presence vector, whose elements are in the $[0, 1]$ interval and which quantify to what extent the subpattern is present in each of the $N$ localities. The presence matrix $P$ is of size $N \times L$, where $L$ is the number of modules and each column corresponds to the presence vector of one module. Both presence and module matrix entries are restricted to real values in the $[0, 1]$ interval, and they reconstruct localities' correlations using a maximum formulation we describe below.
% Omitted all references to NMF and WGCNA which used to be here. Mention somewhere in supplementary, or let reviewers comment if they feel that it's relevant.
\begin{figure}[h]
\centering
\includegraphics[width=\linewidth]{figures/module_extraction.pdf}
\caption{\textbf{Module-based factorization of localities.} \textbf{a}, A locality $i$ is reconstructed by multiplying each module's entries by the module presence for that locality, and then taking the maximum per entry across the $M$ extracted modules. %, multiplied by their presence values for that locality.
\textbf{b}, %To capture the factorization of all latent localities in one term,
Localities are represented as a matrix $\boldsymbol{C}$, where each row is a locality, each column a pair of original features, and each entry the pairwise feature correlation in that locality. Module extraction approximates $\boldsymbol{C}$ using a maximum per entry based on modules $\boldsymbol{M}$ and their presences $\boldsymbol{P}$: it calculates an outer product between each column of $\boldsymbol{P}$ (superscript) and each row of $\boldsymbol{M}$, yielding a tensor of $M$ matrix slices of the same shape as $\boldsymbol{C}$ (Equation \ref{eq:module_outer_product}). Each slice represents a module's contribution to the correlations of a locality. The $M$ dimension is reduced by taking the per element maximum, yielding the reconstructed locality dataset.}
\label{fig:module_extraction}
\end{figure}
\subsubsection{AMF formulation}
The formulation of AMF enables modules to overlap across localities. Crucially, as correlations or measures of associations more broadly cannot be considered additive, we avoid summing correlations and instead use a per element maximum function. This allows modules to contribute potentially overlapping subpatterns of correlations without direct interaction in the reconstruction. To that effect, we reconstruct each correlation $j$ of each locality $i$ by taking the maximum of the modules' corresponding correlation values multiplied by the presences of those module at locality $i$:
\begin{equation}
\centering
\boldsymbol{\hat{C}}_{ij} = \max\left(\boldsymbol{P}_{i} \odot (\boldsymbol{M}^T)_{j}\right),
\label{eq:correlation_module_formulation}
\end{equation}
where $\odot$ is the Hadamard product and single letter subscripts indicate matrix rows. The reconstruction of the entire locality $i$ can then be written as a per element maximum across products of the locality's presence values and the modules %i$
(Figure~\ref{fig:module_extraction}a):
\begin{equation}
\centering
\boldsymbol{\hat{C}}_{i} = \max\limits_{1 \leq j \leq {D \choose 2}}\left(\boldsymbol{P}_{i1} \times \boldsymbol{M}_{1}^T, \boldsymbol{P}_{i2} \times \boldsymbol{M}_{2}^T, ..., \boldsymbol{P}_{iM} \times \boldsymbol{M}_{M}^T\right),
\label{eq:locality_module_formulation}
\end{equation}
where $j$ is the index of a single correlation. Similarly, across all $\ell$ localities, we can take the per element maximum of $M$ matrices (Figure \ref{fig:module_extraction}b), defined for some module $m$ as:
\begin{equation}
\centering
\boldsymbol{P}^m \otimes \boldsymbol{M}_{m}^T =
\begin{bmatrix}
\boldsymbol{P}_{1m} \boldsymbol{M}_{m1} & \boldsymbol{P}_{1m} \boldsymbol{M}_{m2} & \ldots & \boldsymbol{P}_{1m} \boldsymbol{M}_{m {D \choose 2}} \\
\boldsymbol{P}_{2m} \boldsymbol{M}_{m1} & \boldsymbol{P}_{2m} \boldsymbol{M}_{m2} & \ldots & \boldsymbol{P}_{2m} \boldsymbol{M}_{m {D \choose 2}} \\
\vdots & \vdots & \ddots & \vdots \\
\boldsymbol{P}_{\ell m} \boldsymbol{M}_{m1} & \boldsymbol{P}_{\ell m} \boldsymbol{M}_{m2} & \ldots & \boldsymbol{P}_{\ell m} \boldsymbol{M}_{m {D \choose 2}}
\end{bmatrix}
,
\label{eq:module_outer_product}
\end{equation}
where the superscript $m$ denotes the column of the matrix $P$ (the presence vector of some module $m$) and $\otimes$ is the outer product. Intuitively, the reconstruction of all localities is similar to matrix multiplication between the presence matrix and the module matrix, but instead of summing up entries across the module dimension, we take their maximum. In tensor terminology, outer products from Equation \ref{eq:module_outer_product} for each of the modules produce $M$ slices of size $\ell \times {D \choose 2}$, over which we take the per entry maximum to reconstruct the original locality matrix.
\subsubsection{AMF loss function}
To prevent averaging, rather than extraction of reoccurring subpatterns, we up-weigh overestimation errors, similarly to quantile regression \cite{koenker_quantile_2001}, but using a cosine distance instead of mean absolute error. We define the loss function for some locality $i$ as:
\begin{equation}
\centering
\mathcal{L}(\boldsymbol{C}_i, \boldsymbol{\hat{C}}_i) = \frac{||\boldsymbol{C}_i||_2}{\sum_{j \neq i}^\ell ||\boldsymbol{C}_j||_2} \; d_{cos}\left(\mathbf{w}_i \odot \boldsymbol{C}_i, \mathbf{w}_i \odot \boldsymbol{\hat{C}}_i \right) + \gamma \; \text{MAE}(\boldsymbol{C}_i, \boldsymbol{\hat{C}}_i),
\label{eq:amf_loss}
\end{equation}
where $||\,||_2$ are $L2$ norms, $\boldsymbol{\hat{C}}_i$ is the locality reconstruction (Equation \ref{eq:locality_module_formulation}), $\odot$ is the Hadamard product, $d_{cos}$ is cosine distance defined as $d_{cos}(\mathbf{x}, \mathbf{y}) = (1 - cos(\mathbf{x}, \mathbf{y}))$, MAE is the mean absolute error and $\alpha$ the belonging regularization hyperparameter, and $\mathbf{w}_i$ is an overestimation mask, defined as:
\begin{equation}
\centering
w_{ic}=
\begin{cases}
\nu,& \text{if } \boldsymbol{\hat{C}}_{ic} > \boldsymbol{C}_{ic} \\
1, & \text{otherwise}
\end{cases}
,
\label{eq:overestimation}
\end{equation}
where $w_{ic}$ is the weight for locality $i$ and correlation $c$, and $\nu$ is an up-weighing hyperparameter (Appendix~\ref{app:module_extraction}). The cosine distance is the main term of the loss function,
% which is suitable measure of how dissimilar patterns of correlations are in the locality and its reconstruction.
whose semantics we deem appropriate for module extraction because we are more concerned with patterns of correlations than their absolute values. The scale invariant cosine distance is scaled by a locality's $L2$ norm to focus on explaining localities showing many high correlations, as opposed to few correlations or mostly weak correlations. The MAE is a regularization term designed to match the scale of the original correlations. This allows for the evaluation of overestimation in the final solutions (Appendix~\ref{app:module_extraction}). %(see Section \ref{sec:experiments}). More details are in Appendix \ref{app:module_extraction}.
% It is important for the loss function to connect modules one to another. While modules are independent of one another in terms of being combined into, the loss function should ensure their complementarity. This is achieved through cosine similarity. The second term serves as a way of matching scale.
\subsubsection{Deciding on the number of modules}
\label{subsec:module_number}
%We cannot optimize the number of modules used directly, since we aim to extract reoccurring patterns and the loss function aims to reconstruct original correlations as best as possible. In the extreme, the optimal solution for reconstruction would be using $M = \ell$, where each module would be equal to the one locality it is present in -- no reoccuring patterns would be extracted this way.
We decide the number of modules similarly to an approach employed for non-negative matrix factorization (NMF)~\cite{alexandrov_deciphering_2013}. For a given number of modules $M$, we run the AMF method $R$ times using different random initializations of matrices $\boldsymbol{M}$ and $\boldsymbol{P}$. %We denote the number of runs for each $M$ as $H$.
% For every $L$, we calculate the average cosine similarity between localities $C_i$ and their AMF reconstructions $\hat{C}_i$ across the $H$ runs.
To assess the stability of the solution, we find $M$-medoids clusters using all $R \times M$ modules and then calculate the silhouette width based on cosine similarity. %use silhouette width based on $M$-medoids clusters and cosine similarity, using all modules from the $R$ runs (a total of $R \times M$ modules).
A higher silhouette width indicates that similar modules were extracted across the different runs. We repeat this process for various values of $M$, and select a solution with a relatively low number of modules that provides a good trade-off between stability and accurate reconstruction. %(see Section \ref{sec:experiments} for examples).
We argue that lower values of $M$ are desirable, as they will force the optimization to find more global, shared patterns. However, too low a number might force different subpatterns to merge, which should also be reflected in poorer reconstructions. Once a number of modules is chosen, for the final modules, we select the run that has the lowest loss. We comment on limitations in Section \ref{sec:limitations}.
\section{Experiments}
\label{sec:experiments}
We perform experiments to verify and examine the explanations of LAVA. We first look at a latent space as represented by LAVA localities, and show how different local subpatterns of correlation can exhibit different levels of similarity across the latent space. Then, we look at how module extraction reveals and utilizes these similarities by extracting modules of reoccurring subpatterns, and verify their properties mentioned in Section \ref{sec:methods}. Finally, we use LAVA modules to explain a UMAP embedding of a kidney single-cell gene expression dataset, revealing biologically relevant patterns.
\textbf{Datasets} Our experiments are based on two datasets: MNIST handwritten digit images~\cite{lecun_gradient-based_1998}, and KPMP\footnote[1]{Kidney Precision Medicine Project: https://www.kpmp.org/.} single-cell kidney gene expression~\cite{lake_atlas_2023}. The KPMP dataset measures the activity of $\sim$30k genes (features) for $\sim$225k kidney cells (samples)~\cite{stark_rna_2019}. %The KPMP dataset is a gene expression dataset consisting of around $225$ thousand kidney cells. As features, each cell has measured counts of around $20$ thousands RNA sequences (corresponding to genes), which serve as a proxy for the cell's biological activity (phenotype) \cite{stark_rna_2019}.
\textbf{Experimental setup.} We use the following UMAP embeddings~\cite{mcinnes_umap_2020}: for MNIST, we generate a UMAP embedding using default hyperparameters, while for the KPMP data we use the UMAP embedding provided with the dataset. %(Appendix~\ref{app:datasets_embeddings_preprocessing}). %We set the locality size hyperparameter $k$ to $3000$ and $500$, respectively (Appendix~\ref{app:hyperparameter_k}). %We then run LAVA as described in Section \ref{sec:methods} for both embedded datasets: we run the probe placement optimization, calculate correlations for each locality, and run module extraction over the localities' correlations for a varying number of modules.
For KPMP, we additionally remove mitochondrial and ribosomal genes and use only the top $1000$ most variable genes following standard single-cell analysis guidelines~\cite{heumos_best_2023} (Appendix~\ref{app:datasets_embeddings_preprocessing}).
We apply LAVA to each dataset, with the neighborhood size hyperparameter $n$ set to 3000 for MNIST and $500$ for KPMP (Appendix~\ref{app:locality_definition}). %To aid in understanding of the method,
For MNIST, we visualize the correlations of localities or modules as image-sized heatmaps, where the color of each pixel is determined by the sum of its correlations, and additional blue lines are drawn between correlated pixels (visible in most figures; details in Appendix~\ref{app:mnist_visualization}).
\subsection{Local patterns, global subpatterns}
With this experiment, we explore the similarity between correlation patterns across a latent space.
\textbf{Setup.} We use LAVA locality representations of the MNIST UMAP, without extracted modules. As examples, we select two different localities, and then calculate cosine similarity between their and other localities' respective representations. This is done using correlations for all feature pairs, or using subsets involving only features from the top or bottom half of the images. %We also calculate the cosine similarities when looking at correlations of subsets of features, rather than all of them, as described below.
\textbf{Intra- and intercluster heterogeneity.} We observe that patterns of correlations between the original features can be highly dissimilar across localities, even within the same cluster of digits (first column of Figure~\ref{fig:locality_pattern_similarity}). This can be conceptualized as a multivariate version of Simpson's paradox, wherein different groupings of data -- here LAVA localities -- can show different trends in association \cite{samuels_simpsons_1993}, %however, rather than grouping the data based on some features of a statistical study, we use the local spatial organization of the latent embeddings (LAVA's localities).
and highlights the fact that local feature associations cannot be trivially summarized across an entire dataset. \textbf{Subpatterns of correlations alter similarity.} %Instead of looking at all of the correlations at the same time, we can also look at patterns of correlation between different subsets of features. We experiment with this by looking at localities' correlations between pixels either only in the top parts, or only in the bottom parts of the images (second and third column of Figure \ref{fig:locality_pattern_similarity}). We observe that similarity is affected, increasing or decreasing depending on the correlations of each locality.
Considering only locality correlations between pixels from the top or bottom half of the images, we observe variations in the cosine similarities across localities (second and third columns of Figure~\ref{fig:locality_pattern_similarity}). This indicates how different localities across the latent space might share specific subpatterns of correlation, but not others, which is precisely what the module extraction in LAVA aims to capture.
% We hypothesize this fact might also be implicitly exploited by other types of latent space learning methods, or supervised models built on top of them.
%In the following experiments, we go to show how LAVA can automatically reveal subpatterns that occur frequently throughout the latent space using module extraction.
\begin{figure}[h]
\centering
\includegraphics[width=\linewidth]{figures/localities_experiment.pdf}
\caption{Cosine similarities between each of two reference localities and all other localities of the latent MNIST UMAP space in three settings, with example visualizations of similar localities.}
\label{fig:locality_pattern_similarity}
\end{figure}
\subsection{Module extraction quality and module properties}
\label{sec:module_exp}
%In the following experiments,
We analyze the quality of module extraction and the properties of LAVA modules for both datasets.
\begin{wrapfigure}{r}{0.35\textwidth}
\centering
\includegraphics[width=\linewidth]{figures/extraction_results.pdf}
\caption{Module extraction results for MNIST %(\textbf{a})
and KPMP.} %(\textbf{b}).}
\label{fig:extraction_results}
\end{wrapfigure}
\textbf{Setup.} We run module extraction $R=10$ times with different numbers of modules $M$ for each dataset, reporting the main loss term (as cosine similarity instead of distance), overestimation ratio, and silhouette width score (Figure \ref{fig:extraction_results}).
Means and standard deviations of the loss and overestimation ratio are calculated based on the $10$ runs.
%\textbf{Run results.}
\textbf{Stability and reconstruction across runs.} As expected, the loss term cosine similarity increases with larger numbers of modules, resulting in better reconstruction of the original correlations. For MNIST, we observe relatively low silhouette widths irrespective of the number of modules~\cite{rousseeuw_silhouettes_1987}, and smaller standard deviations of the loss, pointing to successful optimization and thus a larger number of equally valid solutions. We hypothesize this is due to a large number of common correlation subpatterns, resulting in more ways to reconstruct locality correlations. %On the other hand, f
For KPMP, we see a gradual decrease in stability (silhouette) with larger numbers of modules, indicating more stable solutions for smaller numbers, but similar instability with larger numbers. \textbf{Number of modules.} %For following experiments, w
We decided to use $9$ modules for both datasets based on the criteria outlined in Subsection \ref{subsec:module_number}. Out of the $10$ runs, %we had for each dataset,
we chose the one with the lowest loss.
\textbf{Modules reveal global subpatterns.} %Next, we look at the presence of chosen modules across the two embedded datasets (Figure \ref{fig:intra_inter}).
For both datasets, the %We notice that in both embeddings,
extracted modules represent globally reoccurring subpatterns not tied to neighboring localities (Figure~\ref{fig:intra_inter}). For MNIST, the first two modules (ordered by sum of presence in the latent space) capture common patterns of correlations between digits $3$, $5$, and $8$, and between digits $4$, $7$, and $9$ (Figure \ref{fig:intra_inter}a). Visualizations of the two modules also show how the extracted correlations come from pixels shared across the digits these localities represent, as we would expect. We observe similar trends for KPMP embeddings (Figure \ref{fig:intra_inter}b), with some modules present across most major cell types (module $3$), and others pertaining to more local regions of embeddings of more specific cell types (epithelial cells in the case of modules $1$, $2$, and $4$). %Modules follow from the fact that
The module extraction in LAVA uses no information about the spatial organization of localities, allowing it to identify shared subpatterns across clusters, and differentiate patterns within clusters.
\begin{figure}[h]
\centering
\includegraphics[width=\linewidth]{figures/intra_inter_experiment.pdf}
\caption{Labels and example module presences for the MNIST and KPMP UMAP embeddings.}
\label{fig:intra_inter}
\end{figure}
%Finally, we assess the two properties of modules from Section \ref{sec:methods}.
%
\textbf{Modules identify reoccurring, not averaged subpatterns.} %Firstly, returning to the results of module extraction,
We observe that AMF extracts modules with overestimation error ratios of around $10\%$ or slightly higher (Figure \ref{fig:extraction_results}). Errors made up of predominantly underestimation indicate that averaged patterns are avoided in favor of sparser, but actually present subpatterns, which can be seen as a type of quantile regression \cite{koenker_quantile_2001}.
Combined with the semantics of cosine similarity, the presence of a module in two localities implies not only a similar subpattern of correlations, but also that the subpattern can directly be observed in both localities. %is similarity can directly be attributed to the presence of the module correlations in both localities. %, thus relating localities in terms of shared correlations.
%In Figure \ref{fig:averaging_simulation},
We visualize this for MNIST by comparing two extracted modules to what they would look like if their LAVA extracted correlations were replaced by the presence-weighted average across localities.
%
\begin{wrapfigure}{r}{0.35\textwidth} % TODO: we do not refer to this figure directly anywhere in the text.
\centering
\includegraphics[width=\linewidth]{figures/averaging_experiment.pdf}
\caption{Extracted modules vs. presence-weighted averages.}
\label{fig:averaging_simulation}
\end{wrapfigure}
\textbf{Multiple modules can coexist in a single locality.} %Secondly, we show that multiple modules can be present at one locality. To verify that this happens
To investigate if LAVA modules can be co-present in the same locality, we scale the presences for each locality to sum to $1$, and calculate Shannon entropy to quantify module co-presence per locality in each dataset. Ignoring localities with summed presences $<0.5$ to prevent inflated entropies from scaling, we get average values of $0.68$ ($\pm 0.41$) and $1.41$ ($\pm 0.75$) for MNIST and KPMP, respectively (Figures \ref{fig:overlap}a and \ref{fig:overlap}b). For reference, $0$ means no overlap between modules and $3.17$ corresponds to all $9$ modules being equally present. The obtained entropies indicate some overlap in both datasets, more so in KPMP.
% In MNIST, different digits having pixels in different places of the images means some correlations will essentially be
Figure~\ref{fig:overlap}c shows an example of how modules overlap to reconstruct correlations of a locality in MNIST. Allowing overlap, a given locality can be related to different subsets of localities through presences of modules, even when those modules represent partially overlapping subpatterns of correlation.
\begin{figure}[h]
\centering
\includegraphics[width=\linewidth]{figures/overlap_experiment.pdf}
\caption{Entropy of module presences per locality for the MNIST and KPMP datasets, with an MNIST example of how modules are combined to reconstruct localities.}
\label{fig:overlap}
\end{figure}
\subsection{Explaining embeddings of gene expression data (KPMP)}
\label{sec:kpmp_exp}
%In the final experiment, w
We investigate if LAVA modules can reveal biologically relevant patterns using the UMAP of KPMP data. \textbf{Setup.} The KPMP dataset includes metadata about the human donors of the cells: we look at disease state, %patients from whom the data were sampled. As a point of interest, we look the disease state category,
which is either healthy, acute kidney failure (ACF), or chronic kidney disease (CKD). We first calculate percentages of samples from donor disease state per locality. We then calculate Pearson correlations and respective p-values between module presences and these percentages (ignoring localities where a module is not present) to gauge the association between module and disease state. %whether a stronger presence of some module in a locality relates to a higher proportion of diseased samples.
We further investigate if genes in those modules are related to biological pathways related to diseased state (Appendix~\ref{app:kpmp_exp}). \textbf{Module correlates with diseased samples.} Cells from patients with different disease states are spread throughout the latent space, with no apparent clustering. However, the presence of module $4$ (Figure \ref{fig:intra_inter}b) is positively correlated with the percentage of diseased samples ($0.23$, $p < 0.01$), and of CKD samples specifically ($0.28$, $p < 0.01$). Together with the fact that module $4$ is present across epithelial cells and not blood cells, this suggests that the correlation subpattern of module $4$ could be biologically relevant for kidney disease related pathways. \textbf{Module genes and disease related pathways.} Overrepresentation analysis of biological pathways~\cite{fang_gseapy} for the set of genes in module $4$ correlations exhibit $21$ significant pathways ($p<0.01$). To highlight biological relevance, we single out the more general ``cellular response to stress'' and the DNA damage response pathways, linked to CKD in previous studies \cite{patera_kidney_2024, schupp_dna_2016, molitoris_dna_nodate, wang_roles_2023}. Overall, our findings suggest that the local organization of KPMP latent UMAP embeddings across kidney tissue cell types exhibits patterns of gene correlation related to kidney disease. This local structure of sample organization is not apparent in the clustering of the data, but notably discoverable through the LAVA modules.
\begin{figure}[h]
\centering
\includegraphics[width=\linewidth]{figures/kpmp_experiment.pdf}
\caption{Module 4 for KPMP: overlap with chronic kidney disease and gene analysis.}
\label{fig:kpmp_experiment}
\end{figure}
\section{Limitations}
\label{sec:limitations}
%In this section, we identify and
%We briefly comment on limitations of LAVA.
\textbf{Defining neighborhood size.} %sizes of neighborhoods.}
A larger limitation of LAVA is the definition of a relevant size for localities. %Limiting our method to manifold learning latent spaces means
Explanations based on local sample groupings are relevant for embeddings produced by techniques like non-linear manifold learning, which themselves try to preserve local relationships, but the choice of neighborhood size remains a challenge. The issue of defining meaningful localities relates more broadly to that of latent axes not corresponding to known quantities or concepts. While in unsupervised settings, exploration of multiple sizes might be of interest, in supervised settings or using metadata, size of locality could be motivated by changes in a target of interest.
\textbf{Association as correlation, and directionality.} We estimate pairwise association between original features with Spearman correlations, therefore more complex associations will not be captured. Furthermore, our module extraction assumes absolute values, and cannot be trivially extended to differentiate between negative and positive correlation because of its use of the maximum function. This means LAVA cannot differentiate correlation reversals.
\textbf{Module extraction.} As we saw in MNIST experiments, module extraction can lead to multiple equally good solutions. Assuming the problem setting is well-defined, each of these solutions is worth exploring, which might not always be practically feasible. %We found it difficult to think of ways to reduce the space of solutions that produces more consistent but equally or more meaningful modules.
We did not look into whether some modules are consistent across the different runs, which might be an exploitable finding. Choosing the number of modules used based on a stability/accuracy trade-off also retains some ambiguity, but is inherent to the unsupervised setting.
\textbf{Unstructured data.} While we experiment with MNIST, our approach is generally suitable for tabular, as opposed to unstructured data such as images and text. %, or DNA and other sequences.
With larger adaptations, a concept-based approach looking at presences of concepts rather than correlations between individual features, might be applicable~\cite{crabbe_concept_2022}.
\section{Conclusions}
In this work, we framed the problem of latent space explainability as enabling reasoning about the relative spatial organization of embeddings and their original data. We focused on explainability for latent embeddings generated by manifold learning that only produce embeddings and no mapping function. %, and therefore consist only of the resulting embeddings.
To that effect, we introduced the LAVA method, which describes local groups of data in the latent space through observed correlations between features in the original data, and relates them globally to one another by revealing reoccurring subpatterns of correlation throughout the latent space. In future work, we envision further exploring the idea of reasoning about latent embeddings spatially, especially for higher-dimensional latent spaces and supervised tasks, in which the spatial relations between embedded samples can be put into context, and differentiated from one another based on specific targets of interest, which we anticipate to be possible building on top of existing feature and sample importance methods. We see this approach having potential to extract more insight from ML models than existing methods, further aiding in model development and knowledge discovery.
% Hidden in submission setting.
\begin{ack}
\textbf{The authors.}
Authors received funding from the US National Institutes of Health [grant numbers U54EY032442, U54DK134302, U01CA294527, and R01AI138581 to JPG; grant numbers U01DK133766 and R01AG078803 to IS and JPG]. Funders were not involved in the research, authors are solely responsible for this work.
\hfill \break
\textbf{The KPMP dataset.}
The results here are in whole or part based upon data generated by the Kidney Precision Medicine Project. Accessed March 1, 2025. https://www.kpmp.org.
Funded by the National Institute of Diabetes and Digestive and Kidney Diseases (Grant numbers: U01DK133081, U01DK133091, U01DK133092, U01DK133093, U01DK133095, U01DK133097, U01DK114866, U01DK114908, U01DK133090, U01DK133113, U01DK133766, U01DK133768, U01DK114907, U01DK114920, U01DK114923, U01DK114933, U24DK114886, UH3DK114926, UH3DK114861, UH3DK114915, UH3DK114937)
\end{ack}
\printbibliography
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
\clearpage
\appendix
% \begin{center}%
% {\LARGE Supplementary Material for ``Explainability for Manifold Learning Embeddings'' \par}% title
% \end{center}%
\pagenumbering{roman}
\setcounter{page}{1}
% Make tables and figures and algorithms have prefixes and restart their counter
\setcounter{figure}{0}
\setcounter{table}{0}
\setcounter{algorithm}{0}
\renewcommand{\thetable}{S\arabic{table}}
\renewcommand{\thefigure}{S\arabic{figure}}
\renewcommand{\thealgorithm}{S\arabic{algorithm}}
\section{Methodology}
\label{app:methodology}
\subsection{Locality Definition}
\label{app:locality_definition}
\subsubsection{Hyperparameter $n$: size of locality}
\label{app:hyperparameter_k}
The choice of $n$ is important as the definition of localities has a substantial influence on correlations that LAVA will calculate in the step (2), and subsequently on module extraction in step (3). A data-driven way of choosing the value $n$ can be looking at which size of latent neighborhood most resembles the neighborhoods in the original feature size. In choosing such a $n$, we attempt to capture localities at a scale that most accurately represents organization in the original feature space. Another, more targeted, approach is motivating the choice of $n$ using metadata of interest. This might ground the scale of localities to existing knowledge and make findings more relevant for a downstream task. We employ both approaches in our experiments in Section \ref{sec:experiments}, and deliberate further in \ref{app:exp_hyperparameters}.
% As a specific example, in trajectory inference, pseudo-time \cite{saelens_comparison_2019} might be used to determine a relevant scale at which to observe changes in variable associations.
\subsubsection{Defining the number of localities}
To determine the number of localities (and respective probes), $\ell$, we look at three factors: the number of embeddings $E$, the size of the neighborhood $n$, and an additional hyperparameter $o$ relating to the overlap between localities. $\ell$ is then defined as:
\begin{equation}
\centering
\ell = [E * o / n],
\end{equation}
where $[\,]$ denotes rounding to the nearest integer. The hyperparameter $o$ determines the number of localities given a dataset and neighborhood size $n$. If all samples were of a similar centrality (e.g., if data are uniformly spread in some space), $o=x$ would mean that each sample would be represented by approximately $x$ localities. A larger $o$ will produce more overlap between localities and enable a representation that more closely approximates the samples' original in-degree centralities, but will be more expensive computationally and harder to manage in subsequent analysis. We recommend using smaller values of $o$ in the range of $2$ to $20$, so that the resulting number of localities $\ell$ is manageable, but still captures the various correlation patterns and how they change across the latent space.
\subsubsection{Optimizing locality placement}
\label{app:opt_loc_plac}
For locality placement, we try to match the relative in-degree centralities of samples when we look at the neighborhoods of all samples and the neighborhoods of localities (see Section \ref{sec:methods} and Equation \ref{eq:direct_loss}). We do this by optimizing parameters $\alpha$ and $\beta$ from Equation \ref{eq:direct_loss} using the $k$-means (here referred to as $\ell$-means) and DIRECT algorithms \cite{jones_lipschitzian_1993}. We use Manhattan instead of Euclidean distances to focus less on outliers and approximate centrality more equally across the samples (conceptually, this is similar to the difference between using mean absolute and mean squared errors). The rationale for using the weighing scheme in Equation \ref{eq:weighing_scheme} is forcing the computationally cheap $\ell$-means algorithm to optimize locality placement so that Equation \ref{eq:direct_loss} is minimized. We want to weigh samples based on their centrality, since the $\ell$-means algorithm optimizes Euclidean distances rather than our objective. Furthermore, the weights in Equation \ref{eq:weighing_scheme} factor in the inverse average distances to offset the fact that $\ell$-means optimizes the sum of squared Euclidean distances between points, which means that lower density regions of the latent space would have more probes (and localities), even when we weigh samples according to their centrality. Put together: we let the DIRECT algorithm optimize the weights of samples for the $\ell$-means algorithm, such that the localities produced by the $\ell$-means algorithm minimize our centrality-based loss function. Note that we use only the resulting centroids of the optimization as probes, while cluster assignments produced by the $\ell$-means algorithm are ignored. The $\ell$ localities are then simply the $n$-sized neighborhoods around each of the $\ell$ probes.
Additionally, the DIRECT algorithm requires a range of values for the parameters in which the loss function is convex. We fix this to $[-4, 4]$ for both $\alpha$ and $\beta$. We conjecture that, at least approximately (especially since $\ell$-means is stochastic), the loss function is convex in that interval and contains a good solution. Loosely, as mentioned above, we want the weighing scheme to be able to overpower the overrepresentation of low-density regions that might occur if we would simply weigh samples based on their centrality. We argue about it in terms of hyperball volume: the hyperball volume is proportional to the $D_L$-th power of its radius, which for a neighborhood of a sample we can approximate by the average distance to its neighbors, where $D_L$ is the dimensionality of the latent space. To battle overrepresentation, we then want to weigh samples with larges ``volumes'' (samples in low density regions) inversely to their volume, so as to effectively force $\ell$-means to give them less importance than they might otherwise have given the squared Euclidean distance optimization. In the two-dimensional case, the hyperball volume is simply the area of the circle, which is proportional to the square of the radius (the average distance of the $n$ nearest neighbors). To allow weighing in such a fashion, we allow $\alpha$ to be at least $2$, and we further multiply by $2$ to allow for exaggeration of this principle. Since we cannot be sure how this weighing will interact with centrality weighing, we allow both parameters to also be negative, and give them the same range, arbitrarily. In our limited experimentation, and with no ground truth to compare to, this seemed to yield good and intuitive results (Figures \ref{fig:mnist_probes} and \ref{fig:kpmp_probes}). If we were to use a higher-dimensional latent space, we would set the range to $[-2D_L, 2D_L]$. %, where $D$ is the dimensionality of the latent space.
The pseudocode, ommiting details about DIRECT, is shown in Algorithm \ref{alg:direct_optimization}. We use the scipy\footnote{\hyperref[https://scipy.org/]{https://scipy.org/}.} implementation of the DIRECT algorithm, and the scikit-learn\footnote{\hyperref[https://scikit-learn.org/]{https://scikit-learn.org/}.} implementation of $k$-means.
\begin{algorithm}[h]
\begin{algorithmic}
\Require{$\mathbf{X} \in \mathbb{R}^{E\times D_L}$%\mathcal{H}^E$
, $\ell$}
\State \textbf{Initialize} $nearest\_neighbors[E, n]$, $in\_neighborhood[E]$, $avg\_n\_distance[E]$
\State $nearest\_neighbors \leftarrow \text{calculate\_nearest\_neighbors}(\mathbf{X}, n)$
\For{$i \in \{1, 2, \dots, E\}%$\mathbf{x} \in \mathbf{X}
$}
\State $avg\_n\_distance[i] \leftarrow \frac{1}{n}\sum_{j=1}^n{||\mathbf{X}_i - nearest\_neighbors[i, j]||_2}$
% \Comment{average Euclidean distance for $k$ nearest neighbors}
\State $in\_neighborhood[i] \leftarrow \frac{1}{E}\sum_{j=1}^E{\mathbbm{1}\left[\mathbf{X}_i \in nearest\_neighbors[j]\right]}$ %\Comment{in-degree centrality}
\EndFor
\\
\State \textbf{Initialize} $localities[\ell, n]$, $probe\_set[\ell]$, %$\alpha_{range}[2]$, $\beta_{range}[2]$,
$\alpha_{opt}$, $\beta_{opt}$
%\State $\alpha_{range} \leftarrow [-4, 4]$ \Comment{value ranges for parameters}
%\State $\beta_{range} \leftarrow [-4, 4]$
\State $\alpha_{opt}, \beta_{opt} \leftarrow \text{locality\_optimization$_{DIRECT}$\footnotemark}(\mathbf{X}, \ell, in\_neighborhood, avg\_n\_distance)$%, \alpha_{range}, \beta_{range})$
\State $probe\_set \leftarrow \text{k\_means}(\ell, \alpha_{opt}, \beta_{opt}).\text{centroids()}$
\State $localities \leftarrow \text{calculate\_nearest\_neighbors}(probe\_set, n)$
\end{algorithmic}
\caption{Locality placement algorithm.}
\label{alg:direct_optimization}
\end{algorithm}
\footnotetext{More information in Section \ref{app:opt_loc_plac}.}
%\subsection{Calculating correlations}
\subsection{Locality Representation}
\label{app:calculating_correlations}
Each locality's correlations are calculated using the standard formulation of the Spearman correlation:
\begin{equation}
r_s(\mathbf{X}_i, \mathbf{X}_j) = \frac{cov\left[\text{R}(\mathbf{X}_i), \text{R}(\mathbf{X}_j)\right]}{\sigma_{\text{R}(\mathbf{X}_i)}, \sigma_{\text{R}(\mathbf{X}_j)}},
\end{equation}
where $X_i$ and $X_j$ are two original input features and $\text{R}$ is a ranking function. Covariance $cov$ and standard deviations $\sigma$ are estimated from the samples within a locality using standard estimators. Overlapping ranks are averaged.
Importantly, if one of the variables has the same value in $75\%$ of the neighborhood, that correlation is set to $0$ for that locality. This is done to prevent overestimation of correlations in cases where there is very little change. Notably, this has been the case for both the MNIST and KPMP datasets in our experiments, as the values of most pixels in MNIST are $0$, while gene expression at the single-cell level in KPMP is generally also very sparse. The value of $75\%$ was set arbitrarily, to allow for some leniency, but also avoid meaningless correlations based on low numbers of samples.
\subsection{Module Extraction}
\label{app:module_extraction}
\subsubsection{AMF loss function and hyperparameters}
The AMF loss function (Equation \ref{eq:amf_loss}) is discussed in Section \ref{sec:module_extraction}. Here, we provide some additional detail and motivation.
\textbf{Different metrics of (dis)similarity.} We decided to use cosine distance for the main term of our loss function. However, a different metric (or divergence) for assessing multivariate (dis)similarity might be equally suitable, e.g., the Kullback-Leibler divergence. Pending further investigation, we did not assess whether the semantics of one of these might be more appropriate for our task than the other. Some work relating to semantics and efficiency of these metrics suggests triangular distance as a more appropriate choice in most contexts \cite{connor_tale_2016}.
\textbf{Up-weighing overestimation and connection to quantile regression.}
The $\nu$ hyperparameter in Equation \ref{eq:amf_loss} determines how up-weighted overestimation errors will be in our loss. Weighing the errors is done similarly to how it is done in univariate quantile regression. The loss for univariate $\tau$-th quantile regression, also known as the pinball loss \cite{steinwart_estimating_2011}, is defined as:
\begin{equation}
\mathcal{L}_{\tau}(y, f(x)) =
\begin{cases}
\tau \, |y - f(x)|& \text{if } y \geq f(x) \\
(1 - \tau) \, |y - f(x)| & \text{if } y < f(x)
\end{cases}
.
\label{eq:pinball}
\end{equation}
Practically speaking, univariate quantile regression produces a weighing scheme between overestimation and underestimation errors: if $\tau > 0.5$, we are less concerned with overestimating $y$ using $f(x)$, and vice versa. Using a $\tau = 0.5$ is equal to doing median regression, which corresponds to a regression that minimizes the mean absolute error rather than using the more standard mean squared error. For more intuition, we recommend reading \cite{koenker_quantile_2001} and \cite{steinwart_estimating_2011}.
The idea for module extraction is to retain the semantics of similar, scale-invariant patterns we get with cosine distance or a similar metric, but allowing for reasoning about the reconstructed correlations in terms similar to quantile regression. Retaining the error weighing with a $\tau < 0.5$ is therefore done to prevent averaging across samples and extract only shared, reoccurring correlations (Section \ref{sec:module_extraction}). Quantile-regression-like reconstructions will allow us to say that correlations present in module-based reconstructions are actually present in the localities with some certainty, or, in terms of errors, that the value of a correlation will be overestimated by at most $\tau$ (approximately). We can quantify whether this is actually the case by looking at the overestimation errors (Figure \ref{fig:extraction_results}), which we calculate as the amount of overestimation errors divided by the total absolute error.
Our hyperparameter $\nu$ that weighs overestimation effectively corresponds to the ratio of weights for the overestimation and underestimation:
\begin{equation}
\centering
\nu = \frac{1 - \tau}{\tau}
.
\end{equation}
Using $\nu$ for weighing overestimation errors when using the mean absolute errors would be equivalent to doing $\tau$-th quantile regression. We have set the hyperparameter $\nu = 9$ in all of our experiments. If we look at the pinball equivalent $\tau$, this would correspond to weighing in $0.1$-th quantile regression. We cannot make direct parallels since we do not optimize the mean absolute error, but we can observe relative amounts of overestimation, which seem to more-or-less correspond to values we would expect if we would to quantile regression (Figure \ref{fig:extraction_results}).
\textbf{Extra: Presence fine-tuning.} While we do not use it in our experiments, our implementation also includes what we call presence fine-tuning. After selecting modules, we can fix the module matrix $\mathbf{M}$ and optimize the presence matrix $\mathbf{P}$ with a pinball loss function (Equation \ref{eq:pinball}), to guarantee that each locality (independent when $\mathbf{M}$ is fixed) has an overestimation ratio exactly equal to some $\tau$. Notice that the modules we find are contingent on the overestimation weighing used in the main loss term, which means that it is not equivalent to first extract, and then simply do fine-tuning at the end.
\textbf{Scale regularization.} The second term in Equation \ref{eq:amf_loss} is a simple mean absolute error term designed to retain scale of reconstruction. The idea behind scaling is simply to make reconstructions of the same scale as the actual locality correlations, as cosine distance is in itself scale invariant. While the cosine similarity should remain relatively unaffected by this regularization, given a low enough hyperparameter $\gamma$, matching scale of the actual locality correlations and our reconstructions will allow us to observe the overestimation ratio of solutions (Section \ref{sec:experiments}; Figure \ref{fig:extraction_results}). Furthermore, due to scale invariance of cosine distance, it is also imaginable that modules avoid overestimation simply by retaining low correlations values across the board: the scaling should push optimization away from such solutions. It is crucial that the scale regularization contains no overestimation weighing, meaning that the ratio of overestimation is purely a result of the up-weighing in the first term of the loss function. This ensures the retainment of the semantics of reoccurring pattern semantics, rather than focusing on absolute values of our solutions.
%
We set $\gamma = 0.0001$ as the default value for scale regularization to have a low impact on the loss function. We also end up manually setting this hyperparameter for the KPMP dataset in the experiments (see Section \ref{app:hp_module_ex}), as we noticed $\gamma=0.001$ had no effect on optimization because of the low amounts of observed correlation.
\textbf{Optimization hyperparameters.} The matrices $\mathbf{P}$ and $\mathbf{M}$ are optimized to minimize the loss function (Equation \ref{eq:amf_loss}) using gradient descent with minibatches of $64$ samples (arbitrarily set), the ADAM optimizer \cite{kingma_adam_2017} with default hyperparameters, and clamping. Clamping is used to force any entries of matrices $\mathbf{P}$ and $\mathbf{M}$ to be within the $[0, 1]$ interval after each step in training. Training is performed until convergence, which we defined as no improvement in the loss function above $1\%$ in $100$ epochs. After convergence, we use the matrices from the iteration with the lowest loss as the final solutions. We developed the code based on the PyTorch library\footnote{\hyperref[https://pytorch.org/]{https://pytorch.org/}.}.
\section{Experiments}
\label{app:exps}
\subsection{Software and hardware}
All our code was developed using Python 3.8 and its libraries\footnote{Code included with supplementary material and will be made available online, conditional on acceptance.}. We ran experiments on Linux compute nodes, comprising of a number of different CPUs and GPUs, details of which we omit to ensure anonymity. Locality placement and correlation calculations took several hours for both datasets. A single module extraction run would take about $5$ to $30$ minutes, increasing with the number of modules, $M$. We also tested all of our code on an Apple M3 Pro with 12 CPU cores and 18GB of RAM, which is what we also used to run Jupyter notebooks for result analysis and plot generation.
\subsection{Datasets, embeddings, and preprocessing}
\label{app:datasets_embeddings_preprocessing}
\subsubsection{MNIST}
The MNIST dataset was downloaded using the Scikit-learn Python library\footnote{\hyperref[https://scikit-learn.org]{https://scikit-learn.org}.} library. No preprocessing was performed on the data. Prior to running LAVA, we created a UMAP embedding of the dataset using the \textsc{UMAP}\footnote{\hyperref[https://umap-learn.readthedocs.io]{https://umap-learn.readthedocs.io}.} library, with default hyperparameters.
\subsubsection{KPMP single-cell kidney atlas, v1.5}
The KPMP single-cell kidney atlas was downloaded from the CELLxGENE website\footnote{\hyperref[https://cellxgene.cziscience.com]{https://cellxgene.cziscience.com}. Specific dataset version: \hyperref[https://datasets.cellxgene.cziscience.com/f5b6d620-76df-45c5-9524-e5631be0e44a.h5ad]{https://datasets.cellxgene.cziscience.com/f5b6d620-76df-45c5-9524-e5631be0e44a.h5ad}.}. The dataset contains a UMAP embedding of the data preprocessed using the Seurat library\footnote{\hyperref[https://satijalab.org/seurat/]{https://satijalab.org/seurat/}.}, which we used for our experiments. More information can be found at the KPMP data portal website\footnote{\hyperref[https://atlas.kpmp.org/]{https://atlas.kpmp.org/}.}. The UMAP of the data can also be explored on the CELLxGENE website\footnote{\hyperref[https://cellxgene.cziscience.com/e/dea717d4-7bc0-4e46-950f-fd7e1cc8df7d.cxg/]{https://cellxgene.cziscience.com/e/dea717d4-7bc0-4e46-950f-fd7e1cc8df7d.cxg/}.}. For module extraction, we removed mitochondiral, ribosomal, and mitochondrial ribosome genes. Then, we selected the top $1000$ most variable genes, based on the gene expression data (after normalization and log transformation).
\subsection{LAVA hyperparameters}
\label{app:exp_hyperparameters}
\subsubsection{Size of locality, $n$}
\label{app:exp_locality_size_k}
\textbf{Data-driven approach (MNIST).} A data-driven way of choosing the value $n$ can be looking at the Jaccard similarity of neighborhoods of varying sizes in the original space and the latent space. Even though methods such as UMAP have hyperparameters that represent the size of neighborhoods that will be optimized for, different neighborhood sizes might end up being optimized (depending on the choice of other hyperparameters and the dataset). For the UMAP of the MNIST dataset used in our experiments (Section \ref{sec:experiments}), we found that with the default hyperparameter of $15$ nearest neighbors, the resulting embedding neighborhoods were most representative of the neighborhoods in the original feature space when $k \approx 3000$ (Figure \ref{fig:umap_jaccard}), which was the value we used for LAVA's hyperparameter in our experiments with MNIST.
\begin{figure}[h!]
\centering
\includegraphics[width=0.32\linewidth]{figures/umap_mnist_default_jaccard_similarity.pdf}
\caption{Average Jaccard similarity between original and latent space neighborhoods, calculated for a UMAP of the MNIST dataset with default parameters. Despite the default neighborhood size parameter being $15$, we found the highest original neighbor retention to be around $3000$ neighbors.}
\label{fig:umap_jaccard}
\end{figure}
\textbf{Meta-data approach (KPMP).} For the KPMP dataset, we were interested in observing patterns of gene correlation on a sub-cell type level. Looking at cell types in the data, we observed the median number of cells for each cell type was $3592$, while the smallest cell type had $148$ cells (Table \ref{tab:cell_type_sizes}). Accordingly, we chose neighborhoods of size $k=500$, as this seemed like a large enough number to capture correlations between gene expression that cannot be considered noise, while small enough to explore differences within most of the cell types.
\begin{table}[h]
\centering
\caption{Quartile statistics of the numbers of samples per cell type.}
\begin{tabular}{|c||c|c|c|c|c|} \hline
& min.& 25\%& 50\%& 75\%& max.\\ \hline \hline
\# cells& 148& 1665& 3592& 9105& 54025\\ \hline
\end{tabular}
\label{tab:cell_type_sizes}
\end{table}
\subsubsection{Module extraction hyperparameters}
\label{app:hp_module_ex}
For module extraction on both MNIST and KPMP, we use default hyperparameters, as defined in Appendix \ref{app:module_extraction}, with one exception: the $\alpha$ regularization hyperparameter from Equation \ref{eq:amf_loss} in KPMP module extraction. \textbf{$\boldsymbol{\alpha}$ for KPMP module extraction.} In our runs, we noticed that using low values for $\alpha$ resulted in high overestimation error ratios. This pointed to the fact that regularization was mostly likely not affecting the loss function. We assumed this was due to the sparsity of gene expression, and subsequent low correlations in many localities. Running module extraction several times, using higher values of $\alpha$, confirmed this hypothesis (Figure \ref{fig:kpmp_mod_ex_alpha}). Increasing the strength of regularization seemed to have no or negative effect on the quality or stability of solutions (the main loss term and silhouette width, respectively). For our experiments, we ended up using $\alpha = 10$, resulting in relatively stable and low error overestimation ratios (Figure \ref{fig:kpmp_mod_ex_alpha}a).
\begin{figure}[h]
\centering
\begin{subfigure}[b]{0.33\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/kpmp/module_number_selection_plot_loss_sil_overest_alpha=10.0.pdf}
\caption{$alpha=10.0$}
\end{subfigure}
\begin{subfigure}[b]{0.33\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/kpmp/module_number_selection_plot_loss_sil_overest_alpha=1.0.pdf}
\caption{$alpha=1.0$}
\end{subfigure}
\begin{subfigure}[b]{0.33\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/kpmp/module_number_selection_plot_loss_sil_overest_alpha=0.01.pdf}
\caption{$alpha=0.01$}
\end{subfigure}
\begin{subfigure}[b]{0.33\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/kpmp/module_number_selection_plot_loss_sil_overest_alpha=0.001.pdf}
\caption{$alpha=0.001$}
\end{subfigure}
\caption{Module extraction runs with different regularization hyperparameter $\alpha$.}
\label{fig:kpmp_mod_ex_alpha}
\end{figure}
\subsection{Visualizations of correlations for the MNIST dataset}
\label{app:mnist_visualization}
The MNIST dataset consists of images that are $28$ pixels high and wide, totaling $784$ pixels. To show the importance of each feature in a correlation matrix, we create a heatmap of the same dimensionality ($28 \times 28$), where the value of a pixel correspond to the sum of the correlations that pixel participates in. Coloring is relative, meaning that it conveys relative importance of pixels for one locality or module (and its corresponding correlation matrix) only, and not across different visualizations. Furthermore, we add lines to connect pixels that are correlated to one another. This helps visualize the correlations which cause some pixels to be important in the first place. To avoid clutter, we exponentiate correlations to the power of $3$, and then remove correlations that are lower than $0.1$ after exponentiation (arbitrarily, for visual clarity). The widths of lines that represent correlations are proportional to their exponents to differentiate between stronger and weaker correlations. Some additional examples of visualizations can be seen in Figure \ref{fig:supp_mnist_visuals}.
Intuitively, we can think about these visualizations as a way to visualize pixel movement in a group of samples. In the case of local groups of similar images of digits, like we had in our experiments with MNIST, we can ascertain correlations will most likely reflect changes in pixel intensity due to minor translations, rotations, stretchings, or shrinkings of images. Firstly, for all of these transformations, we can expect that nearby pixels will be correlated, which we can see in all visualizations (Figure \ref{fig:supp_mnist_visuals}). For the latter three transformations, we can also expect further apart pixels to show patterns of correlation, which we see more clearly in correlations relating to the digits $0$ and $1$, and in some other localities.
\begin{figure}[h!]
\centering
\includegraphics[width=\textwidth]{figures/supplementary_visualizations.pdf}
\caption{Example visualizations of correlations at various localities from our experiments with the MNIST dataset.}
\label{fig:supp_mnist_visuals}
\end{figure}
\clearpage
\subsection{MNIST experiments}
\label{app:mnist_exp}
Here, we show some extra figures and results relating to experiments done with the MNIST dataset. In Figure \ref{fig:mnist_meta_data}, we show the class labels of individual samples in our UMAP embeddings. Then, in Figure \ref{fig:mnist_probes}, we show the relative in-degree centralities of samples when looking at all the neighborhoods and when looking at our locality placement. In Figure \ref{fig:mnist_modules_and_presences}, we visualize all modules and their presences used in our experiments from Section \ref{sec:experiments}. We also show modules and presences for the second and third best solutions when $L=9$ (Figure \ref{fig:mnist_modules_and_presences_second} and Figure \ref{fig:mnist_modules_and_presences_third}). Finally, in Figure \ref{fig:mnist_modules_all_simulated_averages}, we visualize how the chosen modules would look like if they were the presence-weighted average of their localities' correlations, rather than overlapping patterns we extract with AMF (see Section \ref{sec:experiments}).
\begin{figure}[h]
\centering
\includegraphics[width=0.33\linewidth]{figures/supplementary/mnist/a_latent_original_classes.pdf}
\caption{MNIST digit labels across UMAP.}
\label{fig:mnist_meta_data}
\end{figure}
\begin{figure}[h]
\centering
\begin{subfigure}[b]{0.49\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/mnist/centrality.pdf}
\caption{Scaled sample neighborhood in-degree centrality.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.49\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/mnist/probe_sample_impact.pdf}
\caption{Scaled locality in-degree centrality, with probes.}
\end{subfigure}
\caption{MNIST UMAP sample relative centralities before and after locality placement (scaled by $\frac{E}{k}$ to have an average of $1$).}
\label{fig:mnist_probes}
\end{figure}
\begin{figure}[h]
\centering
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/mnist/module_6_presence_rank_0_visualization_and_presence.pdf}
\caption{Module 1.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/mnist/module_0_presence_rank_1_visualization_and_presence.pdf}
\caption{Module 2.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/mnist/module_7_presence_rank_2_visualization_and_presence.pdf}
\caption{Module 3.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/mnist/module_8_presence_rank_3_visualization_and_presence.pdf}
\caption{Module 4.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/mnist/module_1_presence_rank_4_visualization_and_presence.pdf}
\caption{Module 5.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/mnist/module_4_presence_rank_5_visualization_and_presence.pdf}
\caption{Module 6.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/mnist/module_2_presence_rank_6_visualization_and_presence.pdf}
\caption{Module 7.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/mnist/module_5_presence_rank_7_visualization_and_presence.pdf}
\caption{Module 8.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/mnist/module_3_presence_rank_8_visualization_and_presence.pdf}
\caption{Module 9.}
\end{subfigure}
\caption{Visualizations and presences of the 9 extracted modules for MNIST.}
\label{fig:mnist_modules_and_presences}
\end{figure}
\begin{figure}[h]
\centering
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/mnist/module_4_presence_rank_0_visualization_presence_second_example.pdf}
\caption{Module 1.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/mnist/module_6_presence_rank_1_visualization_presence_second_example.pdf}
\caption{Module 2.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/mnist/module_7_presence_rank_2_visualization_presence_second_example.pdf}
\caption{Module 3.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/mnist/module_2_presence_rank_3_visualization_presence_second_example.pdf}
\caption{Module 4.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/mnist/module_0_presence_rank_4_visualization_presence_second_example.pdf}
\caption{Module 5.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/mnist/module_5_presence_rank_5_visualization_presence_second_example.pdf}
\caption{Module 6.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/mnist/module_8_presence_rank_6_visualization_presence_second_example.pdf}
\caption{Module 7.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/mnist/module_3_presence_rank_7_visualization_presence_second_example.pdf}
\caption{Module 8.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/mnist/module_1_presence_rank_8_visualization_presence_second_example.pdf}
\caption{Module 9.}
\end{subfigure}
\caption{Visualizations and presences of the second best 9 modules for MNIST.}
\label{fig:mnist_modules_and_presences_second}
\end{figure}
\begin{figure}[h]
\centering
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/mnist/module_8_presence_rank_0_visualization_presence_third_example.pdf}
\caption{Module 1.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/mnist/module_0_presence_rank_1_visualization_presence_third_example.pdf}
\caption{Module 2.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/mnist/module_3_presence_rank_2_visualization_presence_third_example.pdf}
\caption{Module 3.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/mnist/module_5_presence_rank_3_visualization_presence_third_example.pdf}
\caption{Module 4.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/mnist/module_6_presence_rank_4_visualization_presence_third_example.pdf}
\caption{Module 5.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/mnist/module_2_presence_rank_5_visualization_presence_third_example.pdf}
\caption{Module 6.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/mnist/module_7_presence_rank_6_visualization_presence_third_example.pdf}
\caption{Module 7.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/mnist/module_4_presence_rank_7_visualization_presence_third_example.pdf}
\caption{Module 8.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/mnist/module_1_presence_rank_8_visualization_presence_third_example.pdf}
\caption{Module 9.}
\end{subfigure}
\caption{Visualizations and presences of the third best 9 modules for MNIST.}
\label{fig:mnist_modules_and_presences_third}
\end{figure}
\begin{figure}[h]
\centering
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/mnist/module_6_presence_rank_0_presence_vis_sim_avg_vis_medium.pdf}
\caption{Module 1.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/mnist/module_0_presence_rank_1_presence_vis_sim_avg_vis_medium.pdf}
\caption{Module 2.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/mnist/module_7_presence_rank_2_presence_vis_sim_avg_vis_medium.pdf}
\caption{Module 3.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/mnist/module_8_presence_rank_3_presence_vis_sim_avg_vis_medium.pdf}
\caption{Module 4.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/mnist/module_1_presence_rank_4_presence_vis_sim_avg_vis_medium.pdf}
\caption{Module 5.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/mnist/module_4_presence_rank_5_presence_vis_sim_avg_vis_medium.pdf}
\caption{Module 6.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/mnist/module_6_presence_rank_0_presence_vis_sim_avg_vis_medium.pdf}
\caption{Module 7.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/mnist/module_5_presence_rank_7_presence_vis_sim_avg_vis_medium.pdf}
\caption{Module 8.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/mnist/module_3_presence_rank_8_presence_vis_sim_avg_vis_medium.pdf}
\caption{Module 9.}
\end{subfigure}
\caption{Presences, actual extracted modules, and what modules would look like if they were presence-weighted averages of the localities they reconstruct, for the $9$ extracted MNIST modules.}
\label{fig:mnist_modules_all_simulated_averages}
\end{figure}
\clearpage
\subsection{KPMP experiments}
\label{app:kpmp_exp}
Here, we show some extra figures and results relating to experiments done with the KPMP dataset, and we provide more details on the gene set analysis done in Section \ref{sec:kpmp_exp}.
\subsubsection{Additional figures and results.}
In Figure \ref{fig:kpmp_metadata}, we show cell type and disease category labels for all the samples in the UMAP embeddings. In Figure \ref{fig:kpmp_probes}, we show the relative in-degree centralities of samples when looking at all the neighborhoods and when looking at our locality placement. In Figure \ref{fig:kpmp_presences}, we show the presences of modules chosen for experiments (Section \ref{sec:kpmp_exp}).
\begin{figure}[h]
\centering
\begin{subfigure}[b]{0.66\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/kpmp/cell_type_umap.pdf}
\caption{Cell types.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.33\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/kpmp/disease_umap.pdf}
\caption{Disease states.}
\end{subfigure}
\caption{KPMP metadata.}
\label{fig:kpmp_metadata}
\end{figure}
\begin{figure}[h]
\centering
\begin{subfigure}[b]{0.49\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/kpmp/centrality.pdf}
\caption{Scaled sample neighborhood in-degree centrality.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.49\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/kpmp/probe_sample_impact.pdf}
\caption{Scaled locality in-degree centrality, with probes.}
\end{subfigure}
\caption{KPMP UMAP relative sample centralities before and after locality placement (scaled by $\frac{E}{k}$ to have an average of $1$).}
\label{fig:kpmp_probes}
\end{figure}
\begin{figure}[h]
\centering
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/kpmp/c_module_7_presence_rank_0_presence.pdf}
\caption{Module 1.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/kpmp/c_module_6_presence_rank_1_presence.pdf}
\caption{Module 2.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/kpmp/c_module_8_presence_rank_2_presence.pdf}
\caption{Module 3.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/kpmp/c_module_0_presence_rank_3_presence.pdf}
\caption{Module 4.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/kpmp/c_module_1_presence_rank_4_presence.pdf}
\caption{Module 5.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/kpmp/c_module_2_presence_rank_5_presence.pdf}
\caption{Module 6.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/kpmp/c_module_3_presence_rank_6_presence.pdf}
\caption{Module 7.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/kpmp/c_module_5_presence_rank_7_presence.pdf}
\caption{Module 8.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/kpmp/c_module_4_presence_rank_8_presence.pdf}
\caption{Module 9.}
\end{subfigure}
\caption{Presences of the 9 extracted modules for KPMP.}
\label{fig:kpmp_presences}
\end{figure}
\textbf{Disease category.} In Section \ref{sec:kpmp_exp}, we analyze our modules in relation to disease category of patients from whom the single-cell samples come from. To get a better sense of the data, in Figure \ref{fig:disease_status_percentages}, we visualize the ratios of diseased samples across LAVA's localities. \textbf{Correlations between module presences and disease category ratios.} For each of the modules, we also report correlations between the presences of that module and the ratios of the three different disease categories (Table \ref{tab:disease_correlations}). We calculate correlations only across localities in which the module is actually present, that is, with presence $> 0.01$. We do this because we do not expect that a pattern of correlations in a locality will be caused purely by the number of disease samples. Therefore, we also do not expect any module presences to directly reflect the number of disease samples across the localities. However, we do expect that the presence of a module might reflect the relative number of disease samples across the localities it is present in, as a disease could have a specific influence on gene expression for specific cells, and hence also the correlations we might observe when looking at the embeddings locally.
\begin{figure}[h]
\centering
\begin{subfigure}[b]{0.3\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/kpmp/probe_representation_diseased_ratio.pdf}
\caption{Any disease.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.3\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/kpmp/probe_representation_akf_ratio.pdf}
\caption{AKF: acute kidney failure.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.3\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/kpmp/probe_representation_ckd_ratio.pdf}
\caption{CKD: chronic kidney disease.}
\end{subfigure}
\caption{Percentage of disease categories across localities.}
\label{fig:disease_status_percentages}
\end{figure}
\begin{table}[h]
\tiny
\centering
\begin{tabular}{|c||c|c|c|c|c|c|} \hline
& CKD + AKF, Pear.& CKD + AKF, Spear.& CKD, Pear.& CKD, Spear.& AKF, Pear.& AKF, Spear.\\ \hline \hline
m. 1& $-.06$ ($p=.116$)& $-.06$ ($p=.139$)& $-.11$ ($p=.005$)& $-.08$ ($p=.035$)& $.07$ ($p=.049$)& $.07$ ($p=.052$)\\ \hline
m. 2& $.01$ ($p=.865$)& $.03$ ($p=.473$)& $-.03$ ($p=.592$)& $-.02.$ ($p=.62$)& $.05$ ($p=.292$)& $.08$ ($p=.095$)\\ \hline
m. 3& $-.01$ ($p=.878$)& $-.05$ ($p=.242$)& $-.18$ ($p<.001$)& $-.20$ ($p=$)& $.23$ ($p<.001$)& $.25$ ($p<.001$)\\ \hline
m. 4& $.23$ ($p<.001$)& $.26$ ($p<.001$)& $.28$ ($p<.001$)& $.28$ ($p<.001$)& $-.05$ ($p=.269$)& $.03$ ($p=.501$)\\ \hline
m. 5& $-.05$ ($p=219$)& $-.08$ ($p=.092$)& $-.11$ ($p=.010$)& $-.14$ ($p=.002$)& $.09$ ($p=.042$)& $.08$ ($p=.065$)\\ \hline
m. 6& $-.08$ ($p=.107$)& $-.07$ ($p=.173$)& $-.13$ ($p=.010$)& $-.13$ ($p=.013$)& $.08$ ($p=.126$)& $.12$ ($p=.014$)\\ \hline
m. 7& $-.31$ ($p<.001$)& $-.36$ ($p<.001$)& $-.28$ ($p<.001$)& $.28$ ($p<.001$)& $-.01$ ($p=.846$)& $-.01$ ($p=.790$)\\ \hline
m. 8& $-.13$ ($p=.008$)& $-.17$ ($p<.001$)& $-.22$ ($p<.001$)& $-.20$ ($p<.001$)& $.14$ ($p=.003$)& $.11$ ($p=.028$)\\ \hline
m. 9& $.10$ ($p=.084$)& $.09$ ($p=.127$)& $.04$ ($p=.429$)& $.06$ ($p=.310$)& $.09$ ($p=.099$)& $.14$ ($p=.015$) \\ \hline \end{tabular}
\caption{Correlations between module presences and disease categories.}
\label{tab:disease_correlations}
\end{table}
\subsubsection{Gene pathway analysis}
In Section \ref{sec:kpmp_exp}, we investigated the biological relevance of the patterns uncovered by LAVA based on the UMAP of the KPMP dataset. To do this, we performed overrepresentation analysis (ORA) of biological functions: a statistical method used to determine which functions are statistically overrepresented amongst the functional annotations of the genes in a set of interest (e.g. a LAVA module), compared to what would be expected by chance %ORA is as statistical method used to determine which pre-defined gene sets are more present in a subset of genes of interes than we would expect by chance
\cite{huang_bioinformatics_2009}. %As pre-defined gene sets,
We performed this analysis using three collections of functional annotations we thought were relevant for our disease context: (1) hallmark; (2) canonical pathways; and (3) the gene ontology biological process. These collections were downloaded from MSigDB \footnote{The Molecular Signatures Database, available at \hyperref[https://www.gsea-msigdb.org]{https://www.gsea-msigdb.org}.}. \textbf{Selection of genes per module.} To select the set of genes of interest for ORA, we first summed the correlations of each gene in a module, and then took the set of genes whose sum of correlations was %greater or equal to
$\geq5\%$ of the largest sum %. We show that for all the modules in
(Figure \ref{fig:kpmp_top_genes}). Accordingly, we performed ORA for each module using as background all measured genes from the KPMP dataset (a total of $31332$ genes). The resulting biological function $p$-values were adjusted using the Benjamini-Hochberg correction for multiple testing. \textbf{Results of ORA.} %Based on selected subsets of genes,
We report the top 50 most significant results of ORA for each of the $9$ extracted modules in Figure \ref{fig:kpmp_top_pathways}. In the main paper, we highlighted module $4$ because of its correlation with diseased samples, and CKD specifically (Section \ref{sec:kpmp_exp}, Table \ref{tab:disease_correlations}), which we thought was of biological interest.
\begin{figure}[h]
\centering
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/kpmp/module_7_presence_rank_0_top_75_features.pdf}
\caption{Module 1.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/kpmp/module_6_presence_rank_1_top_75_features.pdf}
\caption{Module 2.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/kpmp/module_8_presence_rank_2_top_75_features.pdf}
\caption{Module 3.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/kpmp/module_0_presence_rank_3_top_75_features.pdf}
\caption{Module 4.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/kpmp/module_1_presence_rank_4_top_75_features.pdf}
\caption{Module 5.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/kpmp/module_2_presence_rank_5_top_75_features.pdf}
\caption{Module 6.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/kpmp/module_3_presence_rank_6_top_75_features.pdf}
\caption{Module 7.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/kpmp/module_5_presence_rank_7_top_75_features.pdf}
\caption{Module 8.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/kpmp/module_4_presence_rank_8_top_75_features.pdf}
\caption{Module 9.}
\end{subfigure}
\caption{Top $75$ genes based on sums of correlations for each extracted module from the KPMP experiments. The orange line represents the cut-off line for gene subsets for ORA, equal to $5\%$ of the largest correlation sum.}
\label{fig:kpmp_top_genes}
\end{figure}
\begin{figure}[h]
\centering
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/kpmp/pathways_top_50_module_7_presence_rank_0.pdf}
\caption{Module 1.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/kpmp/pathways_top_50_module_6_presence_rank_1.pdf}
\caption{Module 2.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/kpmp/pathways_top_50_module_8_presence_rank_2.pdf}
\caption{Module 3.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/kpmp/pathways_top_50_module_0_presence_rank_3.pdf}
\caption{Module 4.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/kpmp/pathways_top_50_module_1_presence_rank_4.pdf}
\caption{Module 5.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/kpmp/pathways_top_50_module_2_presence_rank_5.pdf}
\caption{Module 6.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/kpmp/pathways_top_50_module_3_presence_rank_6.pdf}
\caption{Module 7.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/kpmp/pathways_top_50_module_5_presence_rank_7.pdf}
\caption{Module 8.}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.32\textwidth}
\centering
\includegraphics[width=\textwidth]{figures/supplementary/kpmp/pathways_top_50_module_4_presence_rank_8.pdf}
\caption{Module 9.}
\end{subfigure}
\caption{Top $50$ most significant pathways based on ORA for each of the $9$ extracted modules from the KPMP experiment. The orange line represents the significance $p$-value threshold of $0.01$, i.e., $2$ when looking at $-log_{10}(p)$ values.}
\label{fig:kpmp_top_pathways}
\end{figure}
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
% \clearpage
% \pagenumbering{alph}
% \setcounter{page}{1}
% \section*{NeurIPS Paper Checklist}
% \begin{enumerate}
% \item {\bf Claims}
% \item[] Question: Do the main claims made in the abstract and introduction accurately reflect the paper's contributions and scope?
% \item[] Answer: \answerYes{}
% \item[] Justification: We believe our main claims to be stated clearly, accurately reflecting contribution and scope.
% \item[] Guidelines:
% \begin{itemize}
% \item The answer NA means that the abstract and introduction do not include the claims made in the paper.
% \item The abstract and/or introduction should clearly state the claims made, including the contributions made in the paper and important assumptions and limitations. A No or NA answer to this question will not be perceived well by the reviewers.
% \item The claims made should match theoretical and experimental results, and reflect how much the results can be expected to generalize to other settings.
% \item It is fine to include aspirational goals as motivation as long as it is clear that these goals are not attained by the paper.
% \end{itemize}
% \item {\bf Limitations}
% \item[] Question: Does the paper discuss the limitations of the work performed by the authors?
% \item[] Answer: \answerYes{}
% \item[] Justification: We include a limitations section (Section \ref{sec:limitations}), in which we discuss limitations of the method we introduce and reflect on the performance of the method in different scenarios.
% \item[] Guidelines:
% \begin{itemize}
% \item The answer NA means that the paper has no limitation while the answer No means that the paper has limitations, but those are not discussed in the paper.
% \item The authors are encouraged to create a separate "Limitations" section in their paper.
% \item The paper should point out any strong assumptions and how robust the results are to violations of these assumptions (e.g., independence assumptions, noiseless settings, model well-specification, asymptotic approximations only holding locally). The authors should reflect on how these assumptions might be violated in practice and what the implications would be.
% \item The authors should reflect on the scope of the claims made, e.g., if the approach was only tested on a few datasets or with a few runs. In general, empirical results often depend on implicit assumptions, which should be articulated.
% \item The authors should reflect on the factors that influence the performance of the approach. For example, a facial recognition algorithm may perform poorly when image resolution is low or images are taken in low lighting. Or a speech-to-text system might not be used reliably to provide closed captions for online lectures because it fails to handle technical jargon.
% \item The authors should discuss the computational efficiency of the proposed algorithms and how they scale with dataset size.
% \item If applicable, the authors should discuss possible limitations of their approach to address problems of privacy and fairness.
% \item While the authors might fear that complete honesty about limitations might be used by reviewers as grounds for rejection, a worse outcome might be that reviewers discover limitations that aren't acknowledged in the paper. The authors should use their best judgment and recognize that individual actions in favor of transparency play an important role in developing norms that preserve the integrity of the community. Reviewers will be specifically instructed to not penalize honesty concerning limitations.
% \end{itemize}
% \item {\bf Theory assumptions and proofs}
% \item[] Question: For each theoretical result, does the paper provide the full set of assumptions and a complete (and correct) proof?
% \item[] Answer: \answerNA{}
% \item[] Justification: Our paper does not include theoretical results.
% \item[] Guidelines:
% \begin{itemize}
% \item The answer NA means that the paper does not include theoretical results.
% \item All the theorems, formulas, and proofs in the paper should be numbered and cross-referenced.
% \item All assumptions should be clearly stated or referenced in the statement of any theorems.
% \item The proofs can either appear in the main paper or the supplemental material, but if they appear in the supplemental material, the authors are encouraged to provide a short proof sketch to provide intuition.
% \item Inversely, any informal proof provided in the core of the paper should be complemented by formal proofs provided in appendix or supplemental material.
% \item Theorems and Lemmas that the proof relies upon should be properly referenced.
% \end{itemize}
% \item {\bf Experimental result reproducibility}
% \item[] Question: Does the paper fully disclose all the information needed to reproduce the main experimental results of the paper to the extent that it affects the main claims and/or conclusions of the paper (regardless of whether the code and data are provided or not)?
% \item[] Answer: \answerYes{}
% \item[] Justification: In the main paper and supplementary material, we provide all information required to reproduce experimental results, and additionally include code and references to data used to generate the results. While the developed method includes stochastic procedures that can make different runs of our method produce varying results, the main claims we make are not dependent on specific runs. %we do not make claims based on any specific runs of the method to ensure reproducibility.
% \item[] Guidelines:
% \begin{itemize}
% \item The answer NA means that the paper does not include experiments.
% \item If the paper includes experiments, a No answer to this question will not be perceived well by the reviewers: Making the paper reproducible is important, regardless of whether the code and data are provided or not.
% \item If the contribution is a dataset and/or model, the authors should describe the steps taken to make their results reproducible or verifiable.
% \item Depending on the contribution, reproducibility can be accomplished in various ways. For example, if the contribution is a novel architecture, describing the architecture fully might suffice, or if the contribution is a specific model and empirical evaluation, it may be necessary to either make it possible for others to replicate the model with the same dataset, or provide access to the model. In general. releasing code and data is often one good way to accomplish this, but reproducibility can also be provided via detailed instructions for how to replicate the results, access to a hosted model (e.g., in the case of a large language model), releasing of a model checkpoint, or other means that are appropriate to the research performed.
% \item While NeurIPS does not require releasing code, the conference does require all submissions to provide some reasonable avenue for reproducibility, which may depend on the nature of the contribution. For example
% \begin{enumerate}
% \item If the contribution is primarily a new algorithm, the paper should make it clear how to reproduce that algorithm.
% \item If the contribution is primarily a new model architecture, the paper should describe the architecture clearly and fully.
% \item If the contribution is a new model (e.g., a large language model), then there should either be a way to access this model for reproducing the results or a way to reproduce the model (e.g., with an open-source dataset or instructions for how to construct the dataset).
% \item We recognize that reproducibility may be tricky in some cases, in which case authors are welcome to describe the particular way they provide for reproducibility. In the case of closed-source models, it may be that access to the model is limited in some way (e.g., to registered users), but it should be possible for other researchers to have some path to reproducing or verifying the results.
% \end{enumerate}
% \end{itemize}
% \item {\bf Open access to data and code}
% \item[] Question: Does the paper provide open access to the data and code, with sufficient instructions to faithfully reproduce the main experimental results, as described in supplemental material?
% \item[] Answer: \answerYes{}
% \item[] Justification: The data are publicly available, and the code with instructions will be provided with the supplementary material. A link to a repository with the codebase will be publicly available conditional on acceptance.
% \item[] Guidelines:
% \begin{itemize}
% \item The answer NA means that paper does not include experiments requiring code.
% \item Please see the NeurIPS code and data submission guidelines (\url{https://nips.cc/public/guides/CodeSubmissionPolicy}) for more details.
% \item While we encourage the release of code and data, we understand that this might not be possible, so “No” is an acceptable answer. Papers cannot be rejected simply for not including code, unless this is central to the contribution (e.g., for a new open-source benchmark).
% \item The instructions should contain the exact command and environment needed to run to reproduce the results. See the NeurIPS code and data submission guidelines (\url{https://nips.cc/public/guides/CodeSubmissionPolicy}) for more details.
% \item The authors should provide instructions on data access and preparation, including how to access the raw data, preprocessed data, intermediate data, and generated data, etc.
% \item The authors should provide scripts to reproduce all experimental results for the new proposed method and baselines. If only a subset of experiments are reproducible, they should state which ones are omitted from the script and why.
% \item At submission time, to preserve anonymity, the authors should release anonymized versions (if applicable).
% \item Providing as much information as possible in supplemental material (appended to the paper) is recommended, but including URLs to data and code is permitted.
% \end{itemize}
% \item {\bf Experimental setting/details}
% \item[] Question: Does the paper specify all the training and test details (e.g., data splits, hyperparameters, how they were chosen, type of optimizer, etc.) necessary to understand the results?
% \item[] Answer: \answerYes{}
% \item[] Justification: Yes, all details are provided either in the main text or the appendices.
% \item[] Guidelines:
% \begin{itemize}
% \item The answer NA means that the paper does not include experiments.
% \item The experimental setting should be presented in the core of the paper to a level of detail that is necessary to appreciate the results and make sense of them.
% \item The full details can be provided either with the code, in appendix, or as supplemental material.
% \end{itemize}
% \item {\bf Experiment statistical significance}
% \item[] Question: Does the paper report error bars suitably and correctly defined or other appropriate information about the statistical significance of the experiments?
% \item[] Answer: \answerYes{}
% \item[] Justification: In experiments, we show standard deviations or statistical significance when appropriate (see Figure \ref{fig:extraction_results} and Sections \ref{sec:module_exp} and \ref{sec:kpmp_exp}).
% \item[] Guidelines:
% \begin{itemize}
% \item The answer NA means that the paper does not include experiments.
% \item The authors should answer "Yes" if the results are accompanied by error bars, confidence intervals, or statistical significance tests, at least for the experiments that support the main claims of the paper.
% \item The factors of variability that the error bars are capturing should be clearly stated (for example, train/test split, initialization, random drawing of some parameter, or overall run with given experimental conditions).
% \item The method for calculating the error bars should be explained (closed form formula, call to a library function, bootstrap, etc.)
% \item The assumptions made should be given (e.g., Normally distributed errors).
% \item It should be clear whether the error bar is the standard deviation or the standard error of the mean.
% \item It is OK to report 1-sigma error bars, but one should state it. The authors should preferably report a 2-sigma error bar than state that they have a 96\% CI, if the hypothesis of Normality of errors is not verified.
% \item For asymmetric distributions, the authors should be careful not to show in tables or figures symmetric error bars that would yield results that are out of range (e.g. negative error rates).
% \item If error bars are reported in tables or plots, The authors should explain in the text how they were calculated and reference the corresponding figures or tables in the text.
% \end{itemize}
% \item {\bf Experiments compute resources}
% \item[] Question: For each experiment, does the paper provide sufficient information on the computer resources (type of compute workers, memory, time of execution) needed to reproduce the experiments?
% \item[] Answer: \answerYes{}
% \item[] Justification: We provide information about the computer resources used in the appendix.
% \item[] Guidelines:
% \begin{itemize}
% \item The answer NA means that the paper does not include experiments.
% \item The paper should indicate the type of compute workers CPU or GPU, internal cluster, or cloud provider, including relevant memory and storage.
% \item The paper should provide the amount of compute required for each of the individual experimental runs as well as estimate the total compute.
% \item The paper should disclose whether the full research project required more compute than the experiments reported in the paper (e.g., preliminary or failed experiments that didn't make it into the paper).
% \end{itemize}
% \item {\bf Code of ethics}
% \item[] Question: Does the research conducted in the paper conform, in every respect, with the NeurIPS Code of Ethics \url{https://neurips.cc/public/EthicsGuidelines}?
% \item[] Answer: \answerYes{}
% \item[] Justification: We have reviewed the code of ethics and verified that our research conforms to its guidelines.
% \item[] Guidelines:
% \begin{itemize}
% \item The answer NA means that the authors have not reviewed the NeurIPS Code of Ethics.
% \item If the authors answer No, they should explain the special circumstances that require a deviation from the Code of Ethics.
% \item The authors should make sure to preserve anonymity (e.g., if there is a special consideration due to laws or regulations in their jurisdiction).
% \end{itemize}
% \item {\bf Broader impacts}
% \item[] Question: Does the paper discuss both potential positive societal impacts and negative societal impacts of the work performed?
% \item[] Answer: \answerNA{}
% \item[] Justification: The research introduces a new method for explainability, for which we could not determine any non-generic negative applications.
% \item[] Guidelines:
% \begin{itemize}
% \item The answer NA means that there is no societal impact of the work performed.
% \item If the authors answer NA or No, they should explain why their work has no societal impact or why the paper does not address societal impact.
% \item Examples of negative societal impacts include potential malicious or unintended uses (e.g., disinformation, generating fake profiles, surveillance), fairness considerations (e.g., deployment of technologies that could make decisions that unfairly impact specific groups), privacy considerations, and security considerations.
% \item The conference expects that many papers will be foundational research and not tied to particular applications, let alone deployments. However, if there is a direct path to any negative applications, the authors should point it out. For example, it is legitimate to point out that an improvement in the quality of generative models could be used to generate deepfakes for disinformation. On the other hand, it is not needed to point out that a generic algorithm for optimizing neural networks could enable people to train models that generate Deepfakes faster.
% \item The authors should consider possible harms that could arise when the technology is being used as intended and functioning correctly, harms that could arise when the technology is being used as intended but gives incorrect results, and harms following from (intentional or unintentional) misuse of the technology.
% \item If there are negative societal impacts, the authors could also discuss possible mitigation strategies (e.g., gated release of models, providing defenses in addition to attacks, mechanisms for monitoring misuse, mechanisms to monitor how a system learns from feedback over time, improving the efficiency and accessibility of ML).
% \end{itemize}
% \item {\bf Safeguards}
% \item[] Question: Does the paper describe safeguards that have been put in place for responsible release of data or models that have a high risk for misuse (e.g., pretrained language models, image generators, or scraped datasets)?
% \item[] Answer: \answerNA{}
% \item[] Justification: We do not believe that the paper poses high risk of misuse.
% \item[] Guidelines:
% \begin{itemize}
% \item The answer NA means that the paper poses no such risks.
% \item Released models that have a high risk for misuse or dual-use should be released with necessary safeguards to allow for controlled use of the model, for example by requiring that users adhere to usage guidelines or restrictions to access the model or implementing safety filters.
% \item Datasets that have been scraped from the Internet could pose safety risks. The authors should describe how they avoided releasing unsafe images.
% \item We recognize that providing effective safeguards is challenging, and many papers do not require this, but we encourage authors to take this into account and make a best faith effort.
% \end{itemize}
% \item {\bf Licenses for existing assets}
% \item[] Question: Are the creators or original owners of assets (e.g., code, data, models), used in the paper, properly credited and are the license and terms of use explicitly mentioned and properly respected?
% \item[] Answer: \answerYes{}.
% \item[] Justification: We cite all used assets \cite{lecun_gradient-based_1998, lake_atlas_2023}, and respect licenses and terms of use.
% \item[] Guidelines:
% \begin{itemize}
% \item The answer NA means that the paper does not use existing assets.
% \item The authors should cite the original paper that produced the code package or dataset.
% \item The authors should state which version of the asset is used and, if possible, include a URL.
% \item The name of the license (e.g., CC-BY 4.0) should be included for each asset.
% \item For scraped data from a particular source (e.g., website), the copyright and terms of service of that source should be provided.
% \item If assets are released, the license, copyright information, and terms of use in the package should be provided. For popular datasets, \url{paperswithcode.com/datasets} has curated licenses for some datasets. Their licensing guide can help determine the license of a dataset.
% \item For existing datasets that are re-packaged, both the original license and the license of the derived asset (if it has changed) should be provided.
% \item If this information is not available online, the authors are encouraged to reach out to the asset's creators.
% \end{itemize}
% \item {\bf New assets}
% \item[] Question: Are new assets introduced in the paper well documented and is the documentation provided alongside the assets?
% \item[] Answer: \answerYes{}
% \item[] Justification: The code, used to generate the results of the paper, will be included in supplementary material (and later online) along with instructions on how to run it. Other assets were not introduced by the paper.
% \item[] Guidelines:
% \begin{itemize}
% \item The answer NA means that the paper does not release new assets.
% \item Researchers should communicate the details of the dataset/code/model as part of their submissions via structured templates. This includes details about training, license, limitations, etc.
% \item The paper should discuss whether and how consent was obtained from people whose asset is used.
% \item At submission time, remember to anonymize your assets (if applicable). You can either create an anonymized URL or include an anonymized zip file.
% \end{itemize}
% \item {\bf Crowdsourcing and research with human subjects}
% \item[] Question: For crowdsourcing experiments and research with human subjects, does the paper include the full text of instructions given to participants and screenshots, if applicable, as well as details about compensation (if any)?
% \item[] Answer: \answerNA{}
% \item[] Justification: Paper does not involve crowdsourcing or research with human subjects.
% \item[] Guidelines:
% \begin{itemize}
% \item The answer NA means that the paper does not involve crowdsourcing nor research with human subjects.
% \item Including this information in the supplemental material is fine, but if the main contribution of the paper involves human subjects, then as much detail as possible should be included in the main paper.
% \item According to the NeurIPS Code of Ethics, workers involved in data collection, curation, or other labor should be paid at least the minimum wage in the country of the data collector.
% \end{itemize}
% \item {\bf Institutional review board (IRB) approvals or equivalent for research with human subjects}
% \item[] Question: Does the paper describe potential risks incurred by study participants, whether such risks were disclosed to the subjects, and whether Institutional Review Board (IRB) approvals (or an equivalent approval/review based on the requirements of your country or institution) were obtained?
% \item[] Answer: \answerNA{}
% \item[] Justification: Paper does not involve crowdsourcing or research with human subjects.
% \item[] Guidelines:
% \begin{itemize}
% \item The answer NA means that the paper does not involve crowdsourcing nor research with human subjects.
% \item Depending on the country in which research is conducted, IRB approval (or equivalent) may be required for any human subjects research. If you obtained IRB approval, you should clearly state this in the paper.
% \item We recognize that the procedures for this may vary significantly between institutions and locations, and we expect authors to adhere to the NeurIPS Code of Ethics and the guidelines for their institution.
% \item For initial submissions, do not include any information that would break anonymity (if applicable), such as the institution conducting the review.
% \end{itemize}
% \item {\bf Declaration of LLM usage}
% \item[] Question: Does the paper describe the usage of LLMs if it is an important, original, or non-standard component of the core methods in this research? Note that if the LLM is used only for writing, editing, or formatting purposes and does not impact the core methodology, scientific rigorousness, or originality of the research, declaration is not required.
% %this research?
% \item[] Answer: \answerNA{}
% \item[] Justification: We did not use LLMs for any part of this research.
% \item[] Guidelines:
% \begin{itemize}
% \item The answer NA means that the core method development in this research does not involve LLMs as any important, original, or non-standard components.
% \item Please refer to our LLM policy (\url{https://neurips.cc/Conferences/2025/LLM}) for what should or should not be described.
% \end{itemize}
% \end{enumerate}
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
\end{document}
% $ biblatex auxiliary file $
% $ biblatex bbl format version 3.3 $
% Do not modify the above lines!
%
% This is an auxiliary file used by the 'biblatex' package.
% This file may safely be deleted. It will be recreated by
% biber as required.
%
\begingroup
\makeatletter
\@ifundefined{ver@biblatex.sty}
{\@latex@error
{Missing 'biblatex' package}
{The bibliography requires the 'biblatex' package.}
\aftergroup\endinput}
{}
\endgroup
\refsection{0}
\datalist[entry]{none/global//global/global/global}
\entry{fraassen_pragmatic_1988}{incollection}{}{}
\name{author}{1}{}{%
{{hash=081b9c2e0aa3b61deeb4c038a724b62a}{%
family={Fraassen},
familyi={F\bibinitperiod},
given={Bas\bibnamedelimb C.\bibnamedelimi Van},
giveni={B\bibinitperiod\bibinitdelim C\bibinitperiod\bibinitdelim V\bibinitperiod}}}%
}
\name{editor}{1}{}{%
{{hash=d26e5a28c77245bb78dc1826b357ad30}{%
family={Pitt},
familyi={P\bibinitperiod},
given={Joseph\bibnamedelima C.},
giveni={J\bibinitperiod\bibinitdelim C\bibinitperiod}}}%
}
\list{publisher}{1}{%
{Oxford University Press}%
}
\strng{namehash}{081b9c2e0aa3b61deeb4c038a724b62a}
\strng{fullhash}{081b9c2e0aa3b61deeb4c038a724b62a}
\strng{fullhashraw}{081b9c2e0aa3b61deeb4c038a724b62a}
\strng{bibnamehash}{081b9c2e0aa3b61deeb4c038a724b62a}
\strng{authorbibnamehash}{081b9c2e0aa3b61deeb4c038a724b62a}
\strng{authornamehash}{081b9c2e0aa3b61deeb4c038a724b62a}
\strng{authorfullhash}{081b9c2e0aa3b61deeb4c038a724b62a}
\strng{authorfullhashraw}{081b9c2e0aa3b61deeb4c038a724b62a}
\strng{editorbibnamehash}{d26e5a28c77245bb78dc1826b357ad30}
\strng{editornamehash}{d26e5a28c77245bb78dc1826b357ad30}
\strng{editorfullhash}{d26e5a28c77245bb78dc1826b357ad30}
\strng{editorfullhashraw}{d26e5a28c77245bb78dc1826b357ad30}
\field{sortinit}{1}
\field{sortinithash}{4f6aaa89bab872aa0999fec09ff8e98a}
\field{labelnamesource}{author}
\field{labeltitlesource}{title}
\field{booktitle}{Theories of explanation}
\field{title}{The Pragmatic Theory of Explanation}
\field{year}{1988}
\endentry
\entry{jumper_highly_2021}{article}{}{}
\name{author}{34}{}{%
{{hash=10a7a824028a842a17d901b4ec09993d}{%
family={Jumper},
familyi={J\bibinitperiod},
given={John},
giveni={J\bibinitperiod}}}%
{{hash=173072a12c87679d6e0aeed7dbfb2abc}{%
family={Evans},
familyi={E\bibinitperiod},
given={Richard},
giveni={R\bibinitperiod}}}%
{{hash=4295e4094c426f01903ac60155866130}{%
family={Pritzel},
familyi={P\bibinitperiod},
given={Alexander},
giveni={A\bibinitperiod}}}%
{{hash=3e0f493c1ce741283206bf1f0d3c12f5}{%
family={Green},
familyi={G\bibinitperiod},
given={Tim},
giveni={T\bibinitperiod}}}%
{{hash=79e7b7b6d4522585cad02503c7d5c53c}{%
family={Figurnov},
familyi={F\bibinitperiod},
given={Michael},
giveni={M\bibinitperiod}}}%
{{hash=8e46da9de9e53ea5d37089897d69cdd9}{%
family={Ronneberger},
familyi={R\bibinitperiod},
given={Olaf},
giveni={O\bibinitperiod}}}%
{{hash=c65f7c717e43948afa4c164334478ff0}{%
family={Tunyasuvunakool},
familyi={T\bibinitperiod},
given={Kathryn},
giveni={K\bibinitperiod}}}%
{{hash=8fdcc93ec2f81694fe0e05f9515307f0}{%
family={Bates},
familyi={B\bibinitperiod},
given={Russ},
giveni={R\bibinitperiod}}}%
{{hash=314115f4f8838d7bcb17334f981615d0}{%
family={Žídek},
familyi={Ž\bibinitperiod},
given={Augustin},
giveni={A\bibinitperiod}}}%
{{hash=4b3acabda3fd87e1abd111ed903b2d51}{%
family={Potapenko},
familyi={P\bibinitperiod},
given={Anna},
giveni={A\bibinitperiod}}}%
{{hash=9bb6bd16bbcdb2bb998f8bc4038abede}{%
family={Bridgland},
familyi={B\bibinitperiod},
given={Alex},
giveni={A\bibinitperiod}}}%
{{hash=10928a06d1ffe00108ee7f051eef29a6}{%
family={Meyer},
familyi={M\bibinitperiod},
given={Clemens},
giveni={C\bibinitperiod}}}%
{{hash=c8db325f01e156e511c9a87a5e890d22}{%
family={Kohl},
familyi={K\bibinitperiod},
given={Simon\bibnamedelimb A.\bibnamedelimi A.},
giveni={S\bibinitperiod\bibinitdelim A\bibinitperiod\bibinitdelim A\bibinitperiod}}}%
{{hash=8e2b07cf777b4e100518006a0306d430}{%
family={Ballard},
familyi={B\bibinitperiod},
given={Andrew\bibnamedelima J.},
giveni={A\bibinitperiod\bibinitdelim J\bibinitperiod}}}%
{{hash=699f0d8b3b8c59a0bf815183b5a587d1}{%
family={Cowie},
familyi={C\bibinitperiod},
given={Andrew},
giveni={A\bibinitperiod}}}%
{{hash=a4ad88ba00428c727fd7a7295f097c6d}{%
family={Romera-Paredes},
familyi={R\bibinithyphendelim P\bibinitperiod},
given={Bernardino},
giveni={B\bibinitperiod}}}%
{{hash=948ac64053194ba4926e57c400b43dae}{%
family={Nikolov},
familyi={N\bibinitperiod},
given={Stanislav},
giveni={S\bibinitperiod}}}%
{{hash=e44ef077603c4c2159908f44186dedfa}{%
family={Jain},
familyi={J\bibinitperiod},
given={Rishub},
giveni={R\bibinitperiod}}}%
{{hash=30e117447522ea5c589b531025c81621}{%
family={Adler},
familyi={A\bibinitperiod},
given={Jonas},
giveni={J\bibinitperiod}}}%
{{hash=329e447b0059cd0bc92227b1dd08c81e}{%
family={Back},
familyi={B\bibinitperiod},
given={Trevor},
giveni={T\bibinitperiod}}}%
{{hash=4e381e44037009b1cd834d794735c311}{%
family={Petersen},
familyi={P\bibinitperiod},
given={Stig},
giveni={S\bibinitperiod}}}%
{{hash=d805812e442bf9b99ef9b60be3389113}{%
family={Reiman},
familyi={R\bibinitperiod},
given={David},
giveni={D\bibinitperiod}}}%
{{hash=19819a31d99ee8ba869ec9b7fee14613}{%
family={Clancy},
familyi={C\bibinitperiod},
given={Ellen},
giveni={E\bibinitperiod}}}%
{{hash=00bb8dcd0d7dc6963e2b9481ce8e7cdf}{%
family={Zielinski},
familyi={Z\bibinitperiod},
given={Michal},
giveni={M\bibinitperiod}}}%
{{hash=c06ac6a6fdcf2ee2092d61fc58c1f21b}{%
family={Steinegger},
familyi={S\bibinitperiod},
given={Martin},
giveni={M\bibinitperiod}}}%
{{hash=d33020bce7d227c8dd58677580d8df0f}{%
family={Pacholska},
familyi={P\bibinitperiod},
given={Michalina},
giveni={M\bibinitperiod}}}%
{{hash=de7e7f4d56e896db85f56c06f77016a4}{%
family={Berghammer},
familyi={B\bibinitperiod},
given={Tamas},
giveni={T\bibinitperiod}}}%
{{hash=0c0cd2e2fbeb23bb50214e8c94c61b08}{%
family={Bodenstein},
familyi={B\bibinitperiod},
given={Sebastian},
giveni={S\bibinitperiod}}}%
{{hash=89dbd30410c2085cd059f32c57d4593e}{%
family={Silver},
familyi={S\bibinitperiod},
given={David},
giveni={D\bibinitperiod}}}%
{{hash=494b568c5dc85ba8f3f409635f9c5f25}{%
family={Vinyals},
familyi={V\bibinitperiod},
given={Oriol},
giveni={O\bibinitperiod}}}%
{{hash=211e54ca76df5d8c1de6957d48792545}{%
family={Senior},
familyi={S\bibinitperiod},
given={Andrew\bibnamedelima W.},
giveni={A\bibinitperiod\bibinitdelim W\bibinitperiod}}}%
{{hash=481308b301166b521c74fde6566e97e6}{%
family={Kavukcuoglu},
familyi={K\bibinitperiod},
given={Koray},
giveni={K\bibinitperiod}}}%
{{hash=d0d21ff02dda6c0a7d09ef7436bd329b}{%
family={Kohli},
familyi={K\bibinitperiod},
given={Pushmeet},
giveni={P\bibinitperiod}}}%
{{hash=b160026950ebb1e2286dfb40c15482f5}{%
family={Hassabis},
familyi={H\bibinitperiod},
given={Demis},
giveni={D\bibinitperiod}}}%
}
\strng{namehash}{385b84ff9ec134408fea9aeba42f4525}
\strng{fullhash}{fa5dce0980388f0460da0632f0c9ade1}
\strng{fullhashraw}{fa5dce0980388f0460da0632f0c9ade1}
\strng{bibnamehash}{385b84ff9ec134408fea9aeba42f4525}
\strng{authorbibnamehash}{385b84ff9ec134408fea9aeba42f4525}
\strng{authornamehash}{385b84ff9ec134408fea9aeba42f4525}
\strng{authorfullhash}{fa5dce0980388f0460da0632f0c9ade1}
\strng{authorfullhashraw}{fa5dce0980388f0460da0632f0c9ade1}
\field{sortinit}{2}
\field{sortinithash}{8b555b3791beccb63322c22f3320aa9a}
\field{labelnamesource}{author}
\field{labeltitlesource}{title}
\field{abstract}{Proteins are essential to life, and understanding their structure can facilitate a mechanistic understanding of their function. Through an enormous experimental effort1–4, the structures of around 100,000 unique proteins have been determined5, but this represents a small fraction of the billions of known protein sequences6,7. Structural coverage is bottlenecked by the months to years of painstaking effort required to determine a single protein structure. Accurate computational approaches are needed to address this gap and to enable large-scale structural bioinformatics. Predicting the three-dimensional structure that a protein will adopt based solely on its amino acid sequence—the structure prediction component of the ‘protein folding problem’8—has been an important open research problem for more than 50 years9. Despite recent progress10–14, existing methods fall far short of atomic accuracy, especially when no homologous structure is available. Here we provide the first computational method that can regularly predict protein structures with atomic accuracy even in cases in which no similar structure is known. We validated an entirely redesigned version of our neural network-based model, {AlphaFold}, in the challenging 14th Critical Assessment of protein Structure Prediction ({CASP}14)15, demonstrating accuracy competitive with experimental structures in a majority of cases and greatly outperforming other methods. Underpinning the latest version of {AlphaFold} is a novel machine learning approach that incorporates physical and biological knowledge about protein structure, leveraging multi-sequence alignments, into the design of the deep learning algorithm.}
\field{issn}{1476-4687}
\field{journaltitle}{Nature}
\field{langid}{english}
\field{month}{8}
\field{note}{Publisher: Nature Publishing Group}
\field{number}{7873}
\field{title}{Highly accurate protein structure prediction with {AlphaFold}}
\field{urlday}{27}
\field{urlmonth}{10}
\field{urlyear}{2024}
\field{volume}{596}
\field{year}{2021}
\field{dateera}{ce}
\field{urldateera}{ce}
\field{pages}{583\bibrangedash 589}
\range{pages}{7}
\verb{doi}
\verb 10.1038/s41586-021-03819-2
\endverb
\verb{urlraw}
\verb https://www.nature.com/articles/s41586-021-03819-2
\endverb
\verb{url}
\verb https://www.nature.com/articles/s41586-021-03819-2
\endverb
\keyw{Computational biophysics,Machine learning,Protein structure predictions,Structural biology}
\endentry
\entry{davies_advancing_2021}{article}{}{}
\name{author}{14}{}{%
{{hash=559245987dfd4d4e06a4d0f293c343e5}{%
family={Davies},
familyi={D\bibinitperiod},
given={Alex},
giveni={A\bibinitperiod}}}%
{{hash=b1208a71c9b067bcef8fb29c15a09b5d}{%
family={Veličković},
familyi={V\bibinitperiod},
given={Petar},
giveni={P\bibinitperiod}}}%
{{hash=1565ce82971194591b5780f8588fcc3a}{%
family={Buesing},
familyi={B\bibinitperiod},
given={Lars},
giveni={L\bibinitperiod}}}%
{{hash=fea62a0512aea8dd4fd50d74129bf3b4}{%
family={Blackwell},
familyi={B\bibinitperiod},
given={Sam},
giveni={S\bibinitperiod}}}%
{{hash=79648d990345747c4c4381680ecac237}{%
family={Zheng},
familyi={Z\bibinitperiod},
given={Daniel},
giveni={D\bibinitperiod}}}%
{{hash=a201bff2583f0102a481747f053b5ad3}{%
family={Tomašev},
familyi={T\bibinitperiod},
given={Nenad},
giveni={N\bibinitperiod}}}%
{{hash=dd30495dd4be83f1cafabf64f389c3e7}{%
family={Tanburn},
familyi={T\bibinitperiod},
given={Richard},
giveni={R\bibinitperiod}}}%
{{hash=5a63429a6e1733e8f3f4dc71cbb6eec9}{%
family={Battaglia},
familyi={B\bibinitperiod},
given={Peter},
giveni={P\bibinitperiod}}}%
{{hash=24fe1af011227491e54e299ba4cb24b5}{%
family={Blundell},
familyi={B\bibinitperiod},
given={Charles},
giveni={C\bibinitperiod}}}%
{{hash=71187749fc9856c57a89f7e0c59b646f}{%
family={Juhász},
familyi={J\bibinitperiod},
given={András},
giveni={A\bibinitperiod}}}%
{{hash=8291f5072e4628dace16df61803ed3e0}{%
family={Lackenby},
familyi={L\bibinitperiod},
given={Marc},
giveni={M\bibinitperiod}}}%
{{hash=5db188a620e18347f3db125d9e4e1497}{%
family={Williamson},
familyi={W\bibinitperiod},
given={Geordie},
giveni={G\bibinitperiod}}}%
{{hash=b160026950ebb1e2286dfb40c15482f5}{%
family={Hassabis},
familyi={H\bibinitperiod},
given={Demis},
giveni={D\bibinitperiod}}}%
{{hash=d0d21ff02dda6c0a7d09ef7436bd329b}{%
family={Kohli},
familyi={K\bibinitperiod},
given={Pushmeet},
giveni={P\bibinitperiod}}}%
}
\strng{namehash}{8731be015537f0302ebbb7cba383e08f}
\strng{fullhash}{48d77bcd57a6d2829f4a2359798c9856}
\strng{fullhashraw}{48d77bcd57a6d2829f4a2359798c9856}
\strng{bibnamehash}{8731be015537f0302ebbb7cba383e08f}
\strng{authorbibnamehash}{8731be015537f0302ebbb7cba383e08f}
\strng{authornamehash}{8731be015537f0302ebbb7cba383e08f}
\strng{authorfullhash}{48d77bcd57a6d2829f4a2359798c9856}
\strng{authorfullhashraw}{48d77bcd57a6d2829f4a2359798c9856}
\field{sortinit}{2}
\field{sortinithash}{8b555b3791beccb63322c22f3320aa9a}
\field{labelnamesource}{author}
\field{labeltitlesource}{title}
\field{abstract}{The practice of mathematics involves discovering patterns and using these to formulate and prove conjectures, resulting in theorems. Since the 1960s, mathematicians have used computers to assist in the discovery of patterns and formulation of conjectures1, most famously in the Birch and Swinnerton-Dyer conjecture2, a Millennium Prize Problem3. Here we provide examples of new fundamental results in pure mathematics that have been discovered with the assistance of machine learning—demonstrating a method by which machine learning can aid mathematicians in discovering new conjectures and theorems. We propose a process of using machine learning to discover potential patterns and relations between mathematical objects, understanding them with attribution techniques and using these observations to guide intuition and propose conjectures. We outline this machine-learning-guided framework and demonstrate its successful application to current research questions in distinct areas of pure mathematics, in each case showing how it led to meaningful mathematical contributions on important open problems: a new connection between the algebraic and geometric structure of knots, and a candidate algorithm predicted by the combinatorial invariance conjecture for symmetric groups4. Our work may serve as a model for collaboration between the fields of mathematics and artificial intelligence ({AI}) that can achieve surprising results by leveraging the respective strengths of mathematicians and machine learning.}
\field{issn}{1476-4687}
\field{journaltitle}{Nature}
\field{langid}{english}
\field{month}{12}
\field{note}{Publisher: Nature Publishing Group}
\field{number}{7887}
\field{title}{Advancing mathematics by guiding human intuition with {AI}}
\field{urlday}{27}
\field{urlmonth}{10}
\field{urlyear}{2024}
\field{volume}{600}
\field{year}{2021}
\field{dateera}{ce}
\field{urldateera}{ce}
\field{pages}{70\bibrangedash 74}
\range{pages}{5}
\verb{doi}
\verb 10.1038/s41586-021-04086-x
\endverb
\verb{urlraw}
\verb https://www.nature.com/articles/s41586-021-04086-x
\endverb
\verb{url}
\verb https://www.nature.com/articles/s41586-021-04086-x
\endverb
\keyw{Computer science,Pure mathematics,Statistics}
\endentry
\entry{movva_deciphering_2019}{article}{}{}
\name{author}{6}{}{%
{{hash=20bf473fe16d5a2906d215f3afdae64e}{%
family={Movva},
familyi={M\bibinitperiod},
given={Rajiv},
giveni={R\bibinitperiod}}}%
{{hash=0e54025af2a1956196f0c9cff1997fc6}{%
family={Greenside},
familyi={G\bibinitperiod},
given={Peyton},
giveni={P\bibinitperiod}}}%
{{hash=e22c6eacd4e2bdd92130832e3060b2d0}{%
family={Marinov},
familyi={M\bibinitperiod},
given={Georgi\bibnamedelima K.},
giveni={G\bibinitperiod\bibinitdelim K\bibinitperiod}}}%
{{hash=2319f3ef98f06b3c0feba9588790f8fe}{%
family={Nair},
familyi={N\bibinitperiod},
given={Surag},
giveni={S\bibinitperiod}}}%
{{hash=ed7f55b2e1b04287f942c0e01ee7d521}{%
family={Shrikumar},
familyi={S\bibinitperiod},
given={Avanti},
giveni={A\bibinitperiod}}}%
{{hash=90c89a3bd50a98c5cf297a3ca7939696}{%
family={Kundaje},
familyi={K\bibinitperiod},
given={Anshul},
giveni={A\bibinitperiod}}}%
}
\strng{namehash}{2db2a99117ab6b150dd7aa4ce091729a}
\strng{fullhash}{6bf280cde0846fe1bac4c7a4430d410d}
\strng{fullhashraw}{6bf280cde0846fe1bac4c7a4430d410d}
\strng{bibnamehash}{2db2a99117ab6b150dd7aa4ce091729a}
\strng{authorbibnamehash}{2db2a99117ab6b150dd7aa4ce091729a}
\strng{authornamehash}{2db2a99117ab6b150dd7aa4ce091729a}
\strng{authorfullhash}{6bf280cde0846fe1bac4c7a4430d410d}
\strng{authorfullhashraw}{6bf280cde0846fe1bac4c7a4430d410d}
\field{sortinit}{2}
\field{sortinithash}{8b555b3791beccb63322c22f3320aa9a}
\field{labelnamesource}{author}
\field{labeltitlesource}{title}
\field{abstract}{The relationship between noncoding {DNA} sequence and gene expression is not well-understood. Massively parallel reporter assays ({MPRAs}), which quantify the regulatory activity of large libraries of {DNA} sequences in parallel, are a powerful approach to characterize this relationship. We present {MPRA}-{DragoNN}, a convolutional neural network ({CNN})-based framework to predict and interpret the regulatory activity of {DNA} sequences as measured by {MPRAs}. While our method is generally applicable to a variety of {MPRA} designs, here we trained our model on the Sharpr-{MPRA} dataset that measures the activity of ∼500,000 constructs tiling 15,720 regulatory regions in human K562 and {HepG}2 cell lines. {MPRA}-{DragoNN} predictions were moderately correlated (Spearman ρ = 0.28) with measured activity and were within range of replicate concordance of the assay. State-of-the-art model interpretation methods revealed high-resolution predictive regulatory sequence features that overlapped transcription factor ({TF}) binding motifs. We used the model to investigate the cell type and chromatin state preferences of predictive {TF} motifs. We explored the ability of our model to predict the allelic effects of regulatory variants in an independent {MPRA} experiment and fine map putative functional {SNPs} in loci associated with lipid traits. Our results suggest that interpretable deep learning models trained on {MPRA} data have the potential to reveal meaningful patterns in regulatory {DNA} sequences and prioritize regulatory genetic variants, especially as larger, higher-quality datasets are produced.}
\field{day}{17}
\field{issn}{1932-6203}
\field{journaltitle}{{PLOS} {ONE}}
\field{langid}{english}
\field{month}{6}
\field{note}{Publisher: Public Library of Science}
\field{number}{6}
\field{shortjournal}{{PLOS} {ONE}}
\field{title}{Deciphering regulatory {DNA} sequences and noncoding genetic variants using neural network models of massively parallel reporter assays}
\field{urlday}{27}
\field{urlmonth}{10}
\field{urlyear}{2024}
\field{volume}{14}
\field{year}{2019}
\field{dateera}{ce}
\field{urldateera}{ce}
\field{pages}{e0218073}
\range{pages}{-1}
\verb{doi}
\verb 10.1371/journal.pone.0218073
\endverb
\verb{urlraw}
\verb https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0218073
\endverb
\verb{url}
\verb https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0218073
\endverb
\keyw{Gene expression,Gene regulation,Genome-wide association studies,Nucleotide sequencing,Nucleotides,Sequence motif analysis,Single nucleotide polymorphisms,Transcription factors}
\endentry
\entry{ching_opportunities_2018}{article}{}{}
\name{author}{36}{}{%
{{hash=d74bcb3b3a424053d05614f36be0b63b}{%
family={Ching},
familyi={C\bibinitperiod},
given={Travers},
giveni={T\bibinitperiod}}}%
{{hash=03ac866ea70d20c32f555b0d487f2bf3}{%
family={Himmelstein},
familyi={H\bibinitperiod},
given={Daniel\bibnamedelima S.},
giveni={D\bibinitperiod\bibinitdelim S\bibinitperiod}}}%
{{hash=1a7f9afe12ae34351562adac58d28d6a}{%
family={Beaulieu-Jones},
familyi={B\bibinithyphendelim J\bibinitperiod},
given={Brett\bibnamedelima K.},
giveni={B\bibinitperiod\bibinitdelim K\bibinitperiod}}}%
{{hash=23a4c33f15e72bf295f60a93b48f3a8f}{%
family={Kalinin},
familyi={K\bibinitperiod},
given={Alexandr\bibnamedelima A.},
giveni={A\bibinitperiod\bibinitdelim A\bibinitperiod}}}%
{{hash=e78c54a433371bfe82c551ac5175aeeb}{%
family={Do},
familyi={D\bibinitperiod},
given={Brian\bibnamedelima T.},
giveni={B\bibinitperiod\bibinitdelim T\bibinitperiod}}}%
{{hash=d2f01f296b1757bb64cffe579c27d57c}{%
family={Way},
familyi={W\bibinitperiod},
given={Gregory\bibnamedelima P.},
giveni={G\bibinitperiod\bibinitdelim P\bibinitperiod}}}%
{{hash=6cdfce20c3926f8c1d502a56c1a231fa}{%
family={Ferrero},
familyi={F\bibinitperiod},
given={Enrico},
giveni={E\bibinitperiod}}}%
{{hash=ea9d0732ad2c64f5ca2146920fbf3bc2}{%
family={Agapow},
familyi={A\bibinitperiod},
given={Paul-Michael},
giveni={P\bibinithyphendelim M\bibinitperiod}}}%
{{hash=9fa0347aa0fa6f91c77d5a4ff78d134b}{%
family={Zietz},
familyi={Z\bibinitperiod},
given={Michael},
giveni={M\bibinitperiod}}}%
{{hash=00fa406ff9b739c060596129465813fe}{%
family={Hoffman},
familyi={H\bibinitperiod},
given={Michael\bibnamedelima M.},
giveni={M\bibinitperiod\bibinitdelim M\bibinitperiod}}}%
{{hash=a3f94462dfa72557cc934d7e6b213092}{%
family={Xie},
familyi={X\bibinitperiod},
given={Wei},
giveni={W\bibinitperiod}}}%
{{hash=8bf3ec3a2c84cdc224c1a9a78ce2ac51}{%
family={Rosen},
familyi={R\bibinitperiod},
given={Gail\bibnamedelima L.},
giveni={G\bibinitperiod\bibinitdelim L\bibinitperiod}}}%
{{hash=922717737ce9adb26a66789c845f36d6}{%
family={Lengerich},
familyi={L\bibinitperiod},
given={Benjamin\bibnamedelima J.},
giveni={B\bibinitperiod\bibinitdelim J\bibinitperiod}}}%
{{hash=a2e5ebc8df16f11710b5a34ee98583c1}{%
family={Israeli},
familyi={I\bibinitperiod},
given={Johnny},
giveni={J\bibinitperiod}}}%
{{hash=0202b1011024c94e59d5deef99733913}{%
family={Lanchantin},
familyi={L\bibinitperiod},
given={Jack},
giveni={J\bibinitperiod}}}%
{{hash=a536b2771e80ac29c3caf47fc8701a25}{%
family={Woloszynek},
familyi={W\bibinitperiod},
given={Stephen},
giveni={S\bibinitperiod}}}%
{{hash=26686e149a43924deaff42c8fae349c2}{%
family={Carpenter},
familyi={C\bibinitperiod},
given={Anne\bibnamedelima E.},
giveni={A\bibinitperiod\bibinitdelim E\bibinitperiod}}}%
{{hash=ed7f55b2e1b04287f942c0e01ee7d521}{%
family={Shrikumar},
familyi={S\bibinitperiod},
given={Avanti},
giveni={A\bibinitperiod}}}%
{{hash=716306a09f303b9d16a4e7585e74f403}{%
family={Xu},
familyi={X\bibinitperiod},
given={Jinbo},
giveni={J\bibinitperiod}}}%
{{hash=d4d0330af1369b34251c03df33d1ae23}{%
family={Cofer},
familyi={C\bibinitperiod},
given={Evan\bibnamedelima M.},
giveni={E\bibinitperiod\bibinitdelim M\bibinitperiod}}}%
{{hash=423a76db3d390b8073673adf0af1845d}{%
family={Lavender},
familyi={L\bibinitperiod},
given={Christopher\bibnamedelima A.},
giveni={C\bibinitperiod\bibinitdelim A\bibinitperiod}}}%
{{hash=372e99294a92bb0b162279b46c29179a}{%
family={Turaga},
familyi={T\bibinitperiod},
given={Srinivas\bibnamedelima C.},
giveni={S\bibinitperiod\bibinitdelim C\bibinitperiod}}}%
{{hash=46ee76fda4a41dd89a5df8e05f525ad3}{%
family={Alexandari},
familyi={A\bibinitperiod},
given={Amr\bibnamedelima M.},
giveni={A\bibinitperiod\bibinitdelim M\bibinitperiod}}}%
{{hash=3175f2725bdceeab4ed47c122439add7}{%
family={Lu},
familyi={L\bibinitperiod},
given={Zhiyong},
giveni={Z\bibinitperiod}}}%
{{hash=d08715e5e40bbfc36c0c56c31f74e826}{%
family={Harris},
familyi={H\bibinitperiod},
given={David\bibnamedelima J.},
giveni={D\bibinitperiod\bibinitdelim J\bibinitperiod}}}%
{{hash=0a1e8227baa2cf8b261eb42cd4cfa72c}{%
family={{DeCaprio}},
familyi={D\bibinitperiod},
given={Dave},
giveni={D\bibinitperiod}}}%
{{hash=04b7a7c641a6bc5e81aba25f88ffec13}{%
family={Qi},
familyi={Q\bibinitperiod},
given={Yanjun},
giveni={Y\bibinitperiod}}}%
{{hash=90c89a3bd50a98c5cf297a3ca7939696}{%
family={Kundaje},
familyi={K\bibinitperiod},
given={Anshul},
giveni={A\bibinitperiod}}}%
{{hash=58f0be4b00c7f88fce41e14a40c7e7db}{%
family={Peng},
familyi={P\bibinitperiod},
given={Yifan},
giveni={Y\bibinitperiod}}}%
{{hash=a722ef0f11b81725b5346195868aaf37}{%
family={Wiley},
familyi={W\bibinitperiod},
given={Laura\bibnamedelima K.},
giveni={L\bibinitperiod\bibinitdelim K\bibinitperiod}}}%
{{hash=eef23bb77434f16fbf88366c3aa0b0b8}{%
family={Segler},
familyi={S\bibinitperiod},
given={Marwin\bibnamedelimb H.\bibnamedelimi S.},
giveni={M\bibinitperiod\bibinitdelim H\bibinitperiod\bibinitdelim S\bibinitperiod}}}%
{{hash=be76620c76e58677080efcb2f18cae3d}{%
family={Boca},
familyi={B\bibinitperiod},
given={Simina\bibnamedelima M.},
giveni={S\bibinitperiod\bibinitdelim M\bibinitperiod}}}%
{{hash=3581ea7fd993674acf23234bb6b5d21b}{%
family={Swamidass},
familyi={S\bibinitperiod},
given={S.\bibnamedelimi Joshua},
giveni={S\bibinitperiod\bibinitdelim J\bibinitperiod}}}%
{{hash=b2103b7f1feaa52da552b89e5ed337b7}{%
family={Huang},
familyi={H\bibinitperiod},
given={Austin},
giveni={A\bibinitperiod}}}%
{{hash=e1ec43d0957a58203ffe9b1f36cf9a35}{%
family={Gitter},
familyi={G\bibinitperiod},
given={Anthony},
giveni={A\bibinitperiod}}}%
{{hash=57d81c259b3db1dc8ba3a257da694b0d}{%
family={Greene},
familyi={G\bibinitperiod},
given={Casey\bibnamedelima S.},
giveni={C\bibinitperiod\bibinitdelim S\bibinitperiod}}}%
}
\strng{namehash}{98d255a24ae518f9617c9bbd22b2b70e}
\strng{fullhash}{3469f5f556480a63047bc2e42ba24c1d}
\strng{fullhashraw}{3469f5f556480a63047bc2e42ba24c1d}
\strng{bibnamehash}{98d255a24ae518f9617c9bbd22b2b70e}
\strng{authorbibnamehash}{98d255a24ae518f9617c9bbd22b2b70e}
\strng{authornamehash}{98d255a24ae518f9617c9bbd22b2b70e}
\strng{authorfullhash}{3469f5f556480a63047bc2e42ba24c1d}
\strng{authorfullhashraw}{3469f5f556480a63047bc2e42ba24c1d}
\field{sortinit}{2}
\field{sortinithash}{8b555b3791beccb63322c22f3320aa9a}
\field{labelnamesource}{author}
\field{labeltitlesource}{title}
\field{abstract}{Deep learning describes a class of machine learning algorithms that are capable of combining raw inputs into layers of intermediate features. These algorithms have recently shown impressive results across a variety of domains. Biology and medicine are data-rich disciplines, but the data are complex and often ill-understood. Hence, deep learning techniques may be particularly well suited to solve problems of these fields. We examine applications of deep learning to a variety of biomedical problems—patient classification, fundamental biological processes and treatment of patients—and discuss whether deep learning will be able to transform these tasks or if the biomedical sphere poses unique challenges. Following from an extensive literature review, we find that deep learning has yet to revolutionize biomedicine or definitively resolve any of the most pressing challenges in the field, but promising advances have been made on the prior state of the art. Even though improvements over previous baselines have been modest in general, the recent progress indicates that deep learning methods will provide valuable means for speeding up or aiding human investigation. Though progress has been made linking a specific neural network's prediction to input features, understanding how users should interpret these models to make testable hypotheses about the system under study remains an open challenge. Furthermore, the limited amount of labelled data for training presents problems in some domains, as do legal and privacy constraints on work with sensitive health records. Nonetheless, we foresee deep learning enabling changes at both bench and bedside with the potential to transform several areas of biology and medicine.}
\field{day}{4}
\field{journaltitle}{Journal of The Royal Society Interface}
\field{month}{4}
\field{note}{Publisher: Royal Society}
\field{number}{141}
\field{title}{Opportunities and obstacles for deep learning in biology and medicine}
\field{urlday}{27}
\field{urlmonth}{10}
\field{urlyear}{2024}
\field{volume}{15}
\field{year}{2018}
\field{dateera}{ce}
\field{urldateera}{ce}
\field{pages}{20170387}
\range{pages}{1}
\verb{doi}
\verb 10.1098/rsif.2017.0387
\endverb
\verb{urlraw}
\verb https://royalsocietypublishing.org/doi/full/10.1098/rsif.2017.0387
\endverb
\verb{url}
\verb https://royalsocietypublishing.org/doi/full/10.1098/rsif.2017.0387
\endverb
\keyw{deep learning,genomics,machine learning,precision medicine}
\endentry
\entry{lipton_mythos_2017}{misc}{}{}
\name{author}{1}{}{%
{{hash=599ae457cf41d4ce64e09433edbc964b}{%
family={Lipton},
familyi={L\bibinitperiod},
given={Zachary\bibnamedelima C.},
giveni={Z\bibinitperiod\bibinitdelim C\bibinitperiod}}}%
}
\list{publisher}{1}{%
{arXiv}%
}
\strng{namehash}{599ae457cf41d4ce64e09433edbc964b}
\strng{fullhash}{599ae457cf41d4ce64e09433edbc964b}
\strng{fullhashraw}{599ae457cf41d4ce64e09433edbc964b}
\strng{bibnamehash}{599ae457cf41d4ce64e09433edbc964b}
\strng{authorbibnamehash}{599ae457cf41d4ce64e09433edbc964b}
\strng{authornamehash}{599ae457cf41d4ce64e09433edbc964b}
\strng{authorfullhash}{599ae457cf41d4ce64e09433edbc964b}
\strng{authorfullhashraw}{599ae457cf41d4ce64e09433edbc964b}
\field{sortinit}{3}
\field{sortinithash}{ad6fe7482ffbd7b9f99c9e8b5dccd3d7}
\field{labelnamesource}{author}
\field{labeltitlesource}{title}
\field{abstract}{Supervised machine learning models boast remarkable predictive capabilities. But can you trust your model? Will it work in deployment? What else can it tell you about the world? We want models to be not only good, but interpretable. And yet the task of interpretation appears underspecified. Papers provide diverse and sometimes non-overlapping motivations for interpretability, and offer myriad notions of what attributes render models interpretable. Despite this ambiguity, many papers proclaim interpretability axiomatically, absent further explanation. In this paper, we seek to refine the discourse on interpretability. First, we examine the motivations underlying interest in interpretability, finding them to be diverse and occasionally discordant. Then, we address model properties and techniques thought to confer interpretability, identifying transparency to humans and post-hoc explanations as competing notions. Throughout, we discuss the feasibility and desirability of different notions, and question the oft-made assertions that linear models are interpretable and that deep neural networks are not.}
\field{day}{6}
\field{eprinttype}{arxiv}
\field{month}{3}
\field{number}{{arXiv}:1606.03490}
\field{title}{The Mythos of Model Interpretability}
\field{urlday}{27}
\field{urlmonth}{3}
\field{urlyear}{2025}
\field{year}{2017}
\field{dateera}{ce}
\field{urldateera}{ce}
\verb{doi}
\verb 10.48550/arXiv.1606.03490
\endverb
\verb{eprint}
\verb 1606.03490 [cs]
\endverb
\verb{urlraw}
\verb http://arxiv.org/abs/1606.03490
\endverb
\verb{url}
\verb http://arxiv.org/abs/1606.03490
\endverb
\keyw{Computer Science - Machine Learning,Statistics - Machine Learning,Computer Science - Artificial Intelligence,Computer Science - Computer Vision and Pattern Recognition,Computer Science - Neural and Evolutionary Computing}
\endentry
\entry{humphreys_philosophical_2009}{article}{}{}
\name{author}{1}{}{%
{{hash=46a726d5d9ac5d395c2084547b205e7e}{%
family={Humphreys},
familyi={H\bibinitperiod},
given={Paul},
giveni={P\bibinitperiod}}}%
}
\strng{namehash}{46a726d5d9ac5d395c2084547b205e7e}
\strng{fullhash}{46a726d5d9ac5d395c2084547b205e7e}
\strng{fullhashraw}{46a726d5d9ac5d395c2084547b205e7e}
\strng{bibnamehash}{46a726d5d9ac5d395c2084547b205e7e}
\strng{authorbibnamehash}{46a726d5d9ac5d395c2084547b205e7e}
\strng{authornamehash}{46a726d5d9ac5d395c2084547b205e7e}
\strng{authorfullhash}{46a726d5d9ac5d395c2084547b205e7e}
\strng{authorfullhashraw}{46a726d5d9ac5d395c2084547b205e7e}
\field{sortinit}{3}
\field{sortinithash}{ad6fe7482ffbd7b9f99c9e8b5dccd3d7}
\field{labelnamesource}{author}
\field{labeltitlesource}{title}
\field{journaltitle}{Synthese}
\field{note}{Publisher: Springer}
\field{number}{3}
\field{title}{The Philosophical Novelty of Computer Simulation Methods}
\field{volume}{169}
\field{year}{2009}
\field{dateera}{ce}
\field{pages}{615\bibrangedash 626}
\range{pages}{12}
\verb{doi}
\verb 10.1007/s11229-008-9435-2
\endverb
\endentry
\entry{beisbart_philosophy_2022}{article}{}{}
\name{author}{2}{}{%
{{hash=a101fb84ec3a2dfaa7f0d5fea9286b95}{%
family={Beisbart},
familyi={B\bibinitperiod},
given={Claus},
giveni={C\bibinitperiod}}}%
{{hash=4f802fcfc65466bbc4d30d09100d5af1}{%
family={Räz},
familyi={R\bibinitperiod},
given={Tim},
giveni={T\bibinitperiod}}}%
}
\strng{namehash}{52694ec0a1359500feeed0611153625c}
\strng{fullhash}{52694ec0a1359500feeed0611153625c}
\strng{fullhashraw}{52694ec0a1359500feeed0611153625c}
\strng{bibnamehash}{52694ec0a1359500feeed0611153625c}
\strng{authorbibnamehash}{52694ec0a1359500feeed0611153625c}
\strng{authornamehash}{52694ec0a1359500feeed0611153625c}
\strng{authorfullhash}{52694ec0a1359500feeed0611153625c}
\strng{authorfullhashraw}{52694ec0a1359500feeed0611153625c}
\field{sortinit}{3}
\field{sortinithash}{ad6fe7482ffbd7b9f99c9e8b5dccd3d7}
\field{labelnamesource}{author}
\field{labeltitlesource}{shorttitle}
\field{abstract}{In computer science, there are efforts to make machine learning more interpretable or explainable, and thus to better understand the underlying models, algorithms, and their behavior. But what exactly is interpretability, and how can it be achieved? Such questions lead into philosophical waters because their answers depend on what explanation and understanding are—and thus on issues that have been central to the philosophy of science. In this paper, we review the recent philosophical literature on interpretability. We propose a systematization in terms of four tasks for philosophers: (i) clarify the notion of interpretability, (ii) explain the value of interpretability, (iii) provide frameworks to think about interpretability, and (iv) explore important features of it to adjust our expectations about it.}
\field{issn}{1747-9991}
\field{journaltitle}{Philosophy Compass}
\field{langid}{english}
\field{number}{6}
\field{shorttitle}{Philosophy of science at sea}
\field{title}{Philosophy of science at sea: Clarifying the interpretability of machine learning}
\field{urlday}{28}
\field{urlmonth}{1}
\field{urlyear}{2025}
\field{volume}{17}
\field{year}{2022}
\field{dateera}{ce}
\field{urldateera}{ce}
\field{pages}{e12830}
\range{pages}{-1}
\verb{doi}
\verb 10.1111/phc3.12830
\endverb
\verb{urlraw}
\verb https://onlinelibrary.wiley.com/doi/abs/10.1111/phc3.12830
\endverb
\verb{url}
\verb https://onlinelibrary.wiley.com/doi/abs/10.1111/phc3.12830
\endverb
\endentry
\entry{rudin_stop_2019}{article}{}{}
\name{author}{1}{}{%
{{hash=ed6b4fef67abb4c043b72d1843b36826}{%
family={Rudin},
familyi={R\bibinitperiod},
given={Cynthia},
giveni={C\bibinitperiod}}}%
}
\strng{namehash}{ed6b4fef67abb4c043b72d1843b36826}
\strng{fullhash}{ed6b4fef67abb4c043b72d1843b36826}
\strng{fullhashraw}{ed6b4fef67abb4c043b72d1843b36826}
\strng{bibnamehash}{ed6b4fef67abb4c043b72d1843b36826}
\strng{authorbibnamehash}{ed6b4fef67abb4c043b72d1843b36826}
\strng{authornamehash}{ed6b4fef67abb4c043b72d1843b36826}
\strng{authorfullhash}{ed6b4fef67abb4c043b72d1843b36826}
\strng{authorfullhashraw}{ed6b4fef67abb4c043b72d1843b36826}
\field{sortinit}{4}
\field{sortinithash}{9381316451d1b9788675a07e972a12a7}
\field{labelnamesource}{author}
\field{labeltitlesource}{title}
\field{abstract}{Black box machine learning models are currently being used for high-stakes decision making throughout society, causing problems in healthcare, criminal justice and other domains. Some people hope that creating methods for explaining these black box models will alleviate some of the problems, but trying to explain black box models, rather than creating models that are interpretable in the first place, is likely to perpetuate bad practice and can potentially cause great harm to society. The way forward is to design models that are inherently interpretable. This Perspective clarifies the chasm between explaining black boxes and using inherently interpretable models, outlines several key reasons why explainable black boxes should be avoided in high-stakes decisions, identifies challenges to interpretable machine learning, and provides several example applications where interpretable models could potentially replace black box models in criminal justice, healthcare and computer vision.}
\field{issn}{2522-5839}
\field{journaltitle}{Nature Machine Intelligence}
\field{langid}{english}
\field{month}{5}
\field{note}{Publisher: Nature Publishing Group}
\field{number}{5}
\field{shortjournal}{Nat Mach Intell}
\field{title}{Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead}
\field{urlday}{22}
\field{urlmonth}{10}
\field{urlyear}{2024}
\field{volume}{1}
\field{year}{2019}
\field{dateera}{ce}
\field{urldateera}{ce}
\field{pages}{206\bibrangedash 215}
\range{pages}{10}
\verb{doi}
\verb 10.1038/s42256-019-0048-x
\endverb
\verb{urlraw}
\verb https://www.nature.com/articles/s42256-019-0048-x
\endverb
\verb{url}
\verb https://www.nature.com/articles/s42256-019-0048-x
\endverb
\keyw{Computer science,Criminology,Science,Statistics,technology and society}
\endentry
\entry{murdoch_definitions_2019}{article}{}{}
\name{author}{5}{}{%
{{hash=22c46697552a85457f5d2a862a502350}{%
family={Murdoch},
familyi={M\bibinitperiod},
given={W.\bibnamedelimi James},
giveni={W\bibinitperiod\bibinitdelim J\bibinitperiod}}}%
{{hash=d46196fdd4e251f39ed2cc52b0308d4b}{%
family={Singh},
familyi={S\bibinitperiod},
given={Chandan},
giveni={C\bibinitperiod}}}%
{{hash=13e53b7130829772308671d8809a92f2}{%
family={Kumbier},
familyi={K\bibinitperiod},
given={Karl},
giveni={K\bibinitperiod}}}%
{{hash=31d85fc904c5901571f1ff0edcd3bf80}{%
family={Abbasi-Asl},
familyi={A\bibinithyphendelim A\bibinitperiod},
given={Reza},
giveni={R\bibinitperiod}}}%
{{hash=43d22dc81cc0e5bb1d24d5eeb65ecbae}{%
family={Yu},
familyi={Y\bibinitperiod},
given={Bin},
giveni={B\bibinitperiod}}}%
}
\strng{namehash}{37d6aee03aa03f5d5b08353bc019e388}
\strng{fullhash}{b044182d5bd267eb97319fc6439993ff}
\strng{fullhashraw}{b044182d5bd267eb97319fc6439993ff}
\strng{bibnamehash}{37d6aee03aa03f5d5b08353bc019e388}
\strng{authorbibnamehash}{37d6aee03aa03f5d5b08353bc019e388}
\strng{authornamehash}{37d6aee03aa03f5d5b08353bc019e388}
\strng{authorfullhash}{b044182d5bd267eb97319fc6439993ff}
\strng{authorfullhashraw}{b044182d5bd267eb97319fc6439993ff}
\field{sortinit}{4}
\field{sortinithash}{9381316451d1b9788675a07e972a12a7}
\field{labelnamesource}{author}
\field{labeltitlesource}{title}
\field{abstract}{Machine-learning models have demonstrated great success in learning complex patterns that enable them to make predictions about unobserved data. In addition to using models for prediction, the ability to interpret what a model has learned is receiving an increasing amount of attention. However, this increased focus has led to considerable confusion about the notion of interpretability. In particular, it is unclear how the wide array of proposed interpretation methods are related and what common concepts can be used to evaluate them. We aim to address these concerns by defining interpretability in the context of machine learning and introducing the predictive, descriptive, relevant ({PDR}) framework for discussing interpretations. The {PDR} framework provides 3 overarching desiderata for evaluation: predictive accuracy, descriptive accuracy, and relevancy, with relevancy judged relative to a human audience. Moreover, to help manage the deluge of interpretation methods, we introduce a categorization of existing techniques into model-based and post hoc categories, with subgroups including sparsity, modularity, and simulatability. To demonstrate how practitioners can use the {PDR} framework to evaluate and understand interpretations, we provide numerous real-world examples. These examples highlight the often underappreciated role played by human audiences in discussions of interpretability. Finally, based on our framework, we discuss limitations of existing methods and directions for future work. We hope that this work will provide a common vocabulary that will make it easier for both practitioners and researchers to discuss and choose from the full range of interpretation methods.}
\field{day}{29}
\field{journaltitle}{Proceedings of the National Academy of Sciences}
\field{month}{10}
\field{note}{Publisher: Proceedings of the National Academy of Sciences}
\field{number}{44}
\field{title}{Definitions, methods, and applications in interpretable machine learning}
\field{urlday}{18}
\field{urlmonth}{9}
\field{urlyear}{2024}
\field{volume}{116}
\field{year}{2019}
\field{dateera}{ce}
\field{urldateera}{ce}
\field{pages}{22071\bibrangedash 22080}
\range{pages}{10}
\verb{doi}
\verb 10.1073/pnas.1900654116
\endverb
\verb{urlraw}
\verb https://www.pnas.org/doi/full/10.1073/pnas.1900654116
\endverb
\verb{url}
\verb https://www.pnas.org/doi/full/10.1073/pnas.1900654116
\endverb
\endentry
\entry{wang_scientific_2023}{article}{}{}
\name{author}{30}{}{%
{{hash=a55bf320c291130ee3bcceeb66c27ce0}{%
family={Wang},
familyi={W\bibinitperiod},
given={Hanchen},
giveni={H\bibinitperiod}}}%
{{hash=e082145dbef1d25c41cbb4104e92fe90}{%
family={Fu},
familyi={F\bibinitperiod},
given={Tianfan},
giveni={T\bibinitperiod}}}%
{{hash=16ba464b4b0d4d57bcb1466a73a1b7ba}{%
family={Du},
familyi={D\bibinitperiod},
given={Yuanqi},
giveni={Y\bibinitperiod}}}%
{{hash=c27a06ec124cee9d75602ebedb1e5bd9}{%
family={Gao},
familyi={G\bibinitperiod},
given={Wenhao},
giveni={W\bibinitperiod}}}%
{{hash=20b2c9f80d5574f01211ed9ecca40a92}{%
family={Huang},
familyi={H\bibinitperiod},
given={Kexin},
giveni={K\bibinitperiod}}}%
{{hash=1c58afd2046daf734847b96dab2bf564}{%
family={Liu},
familyi={L\bibinitperiod},
given={Ziming},
giveni={Z\bibinitperiod}}}%
{{hash=5ae310cf79d0b3644dc03264891651cb}{%
family={Chandak},
familyi={C\bibinitperiod},
given={Payal},
giveni={P\bibinitperiod}}}%
{{hash=1a78a9a1504a289cc3b89db85644c024}{%
family={Liu},
familyi={L\bibinitperiod},
given={Shengchao},
giveni={S\bibinitperiod}}}%
{{hash=238116cb6eadb61bfd9c01ec8c1ad929}{%
family={Van\bibnamedelima Katwyk},
familyi={V\bibinitperiod\bibinitdelim K\bibinitperiod},
given={Peter},
giveni={P\bibinitperiod}}}%
{{hash=1f4d8c376133008af929850877ff1d58}{%
family={Deac},
familyi={D\bibinitperiod},
given={Andreea},
giveni={A\bibinitperiod}}}%
{{hash=bd4a2be6ede169a3c794a1cd7e3fb9a2}{%
family={Anandkumar},
familyi={A\bibinitperiod},
given={Anima},
giveni={A\bibinitperiod}}}%
{{hash=0bed201b12a801b5fbec0e52f0b83c04}{%
family={Bergen},
familyi={B\bibinitperiod},
given={Karianne},
giveni={K\bibinitperiod}}}%
{{hash=bd5d717cb5fada5c376f42750d6ab98a}{%
family={Gomes},
familyi={G\bibinitperiod},
given={Carla\bibnamedelima P.},
giveni={C\bibinitperiod\bibinitdelim P\bibinitperiod}}}%
{{hash=3b755f0738ae9e96bfddd2247581347f}{%
family={Ho},
familyi={H\bibinitperiod},
given={Shirley},
giveni={S\bibinitperiod}}}%
{{hash=d0d21ff02dda6c0a7d09ef7436bd329b}{%
family={Kohli},
familyi={K\bibinitperiod},
given={Pushmeet},
giveni={P\bibinitperiod}}}%
{{hash=795443b0ed62ad91d4e4480f24c4e1ce}{%
family={Lasenby},
familyi={L\bibinitperiod},
given={Joan},
giveni={J\bibinitperiod}}}%
{{hash=900d107125ff0ca84698cb909e4f6c51}{%
family={Leskovec},
familyi={L\bibinitperiod},
given={Jure},
giveni={J\bibinitperiod}}}%
{{hash=716b89cbb7332599ebb33cc58a52f648}{%
family={Liu},
familyi={L\bibinitperiod},
given={Tie-Yan},
giveni={T\bibinithyphendelim Y\bibinitperiod}}}%
{{hash=0aa947642bb7e7c27a43e4fb51b2c8cb}{%
family={Manrai},
familyi={M\bibinitperiod},
given={Arjun},
giveni={A\bibinitperiod}}}%
{{hash=ff01797c990c10bb461fb68fd6c42bb4}{%
family={Marks},
familyi={M\bibinitperiod},
given={Debora},
giveni={D\bibinitperiod}}}%
{{hash=6846cc99295752b57e920fdc36e377f2}{%
family={Ramsundar},
familyi={R\bibinitperiod},
given={Bharath},
giveni={B\bibinitperiod}}}%
{{hash=da5283630e781fb48ecf4859f54bca52}{%
family={Song},
familyi={S\bibinitperiod},
given={Le},
giveni={L\bibinitperiod}}}%
{{hash=a1b0869dc74267b9c5cd955132f0ef7d}{%
family={Sun},
familyi={S\bibinitperiod},
given={Jimeng},
giveni={J\bibinitperiod}}}%
{{hash=541194db9dac70af45a28c067d289c8d}{%
family={Tang},
familyi={T\bibinitperiod},
given={Jian},
giveni={J\bibinitperiod}}}%
{{hash=b1208a71c9b067bcef8fb29c15a09b5d}{%
family={Veličković},
familyi={V\bibinitperiod},
given={Petar},
giveni={P\bibinitperiod}}}%
{{hash=53d2880ad8047b61cdae2c6b2803e763}{%
family={Welling},
familyi={W\bibinitperiod},
given={Max},
giveni={M\bibinitperiod}}}%
{{hash=421de55f56f03a9283739635944e8e59}{%
family={Zhang},
familyi={Z\bibinitperiod},
given={Linfeng},
giveni={L\bibinitperiod}}}%
{{hash=85ad2ee11d862ab56d14ae9541c11677}{%
family={Coley},
familyi={C\bibinitperiod},
given={Connor\bibnamedelima W.},
giveni={C\bibinitperiod\bibinitdelim W\bibinitperiod}}}%
{{hash=40a8e4774982146adc2688546f54efb2}{%
family={Bengio},
familyi={B\bibinitperiod},
given={Yoshua},
giveni={Y\bibinitperiod}}}%
{{hash=5f1df07c5fbd5a91d0e32b8697082857}{%
family={Zitnik},
familyi={Z\bibinitperiod},
given={Marinka},
giveni={M\bibinitperiod}}}%
}
\strng{namehash}{93469cdf5075d816361bd3746b1dd335}
\strng{fullhash}{36a8588739d620d909dfd0c0d7fc2f17}
\strng{fullhashraw}{36a8588739d620d909dfd0c0d7fc2f17}
\strng{bibnamehash}{93469cdf5075d816361bd3746b1dd335}
\strng{authorbibnamehash}{93469cdf5075d816361bd3746b1dd335}
\strng{authornamehash}{93469cdf5075d816361bd3746b1dd335}
\strng{authorfullhash}{36a8588739d620d909dfd0c0d7fc2f17}
\strng{authorfullhashraw}{36a8588739d620d909dfd0c0d7fc2f17}
\field{extraname}{1}
\field{sortinit}{4}
\field{sortinithash}{9381316451d1b9788675a07e972a12a7}
\field{labelnamesource}{author}
\field{labeltitlesource}{title}
\field{abstract}{Artificial intelligence ({AI}) is being increasingly integrated into scientific discovery to augment and accelerate research, helping scientists to generate hypotheses, design experiments, collect and interpret large datasets, and gain insights that might not have been possible using traditional scientific methods alone. Here we examine breakthroughs over the past decade that include self-supervised learning, which allows models to be trained on vast amounts of unlabelled data, and geometric deep learning, which leverages knowledge about the structure of scientific data to enhance model accuracy and efficiency. Generative {AI} methods can create designs, such as small-molecule drugs and proteins, by analysing diverse data modalities, including images and sequences. We discuss how these methods can help scientists throughout the scientific process and the central issues that remain despite such advances. Both developers and users of {AI} tools need a better understanding of when such approaches need improvement, and challenges posed by poor data quality and stewardship remain. These issues cut across scientific disciplines and require developing foundational algorithmic approaches that can contribute to scientific understanding or acquire it autonomously, making them critical areas of focus for {AI} innovation.}
\field{issn}{1476-4687}
\field{journaltitle}{Nature}
\field{langid}{english}
\field{month}{8}
\field{note}{Publisher: Nature Publishing Group}
\field{number}{7972}
\field{title}{Scientific discovery in the age of artificial intelligence}
\field{urlday}{27}
\field{urlmonth}{10}
\field{urlyear}{2024}
\field{volume}{620}
\field{year}{2023}
\field{dateera}{ce}
\field{urldateera}{ce}
\field{pages}{47\bibrangedash 60}
\range{pages}{14}
\verb{doi}
\verb 10.1038/s41586-023-06221-2
\endverb
\verb{urlraw}
\verb https://www.nature.com/articles/s41586-023-06221-2
\endverb
\verb{url}
\verb https://www.nature.com/articles/s41586-023-06221-2
\endverb
\keyw{Computer science,Machine learning,Scientific community,Statistics}
\endentry
\entry{higgins_towards_2018}{misc}{}{}
\name{author}{7}{}{%
{{hash=08a44a7f6d4c6a9b876d60071925d7a7}{%
family={Higgins},
familyi={H\bibinitperiod},
given={Irina},
giveni={I\bibinitperiod}}}%
{{hash=8398be8d4929d682a7ca7a58eeb66eea}{%
family={Amos},
familyi={A\bibinitperiod},
given={David},
giveni={D\bibinitperiod}}}%
{{hash=d4d433f1bc6bf06aecb4da73f2e81f0c}{%
family={Pfau},
familyi={P\bibinitperiod},
given={David},
giveni={D\bibinitperiod}}}%
{{hash=5c2c87fd2a8b549866d4fa7ea9bd1de6}{%
family={Racaniere},
familyi={R\bibinitperiod},
given={Sebastien},
giveni={S\bibinitperiod}}}%
{{hash=4ca99bbd5d79fc2a098b19d509dfd618}{%
family={Matthey},
familyi={M\bibinitperiod},
given={Loic},
giveni={L\bibinitperiod}}}%
{{hash=9cc8aeb0de8b3e29d29d6aeaad3f7d9b}{%
family={Rezende},
familyi={R\bibinitperiod},
given={Danilo},
giveni={D\bibinitperiod}}}%
{{hash=ab8697e1baff9a8e44cb823b3c9d1013}{%
family={Lerchner},
familyi={L\bibinitperiod},
given={Alexander},
giveni={A\bibinitperiod}}}%
}
\list{publisher}{1}{%
{arXiv}%
}
\strng{namehash}{9f67f65c7a3314e532e2c457dee12c49}
\strng{fullhash}{3581ff1520adaf2bb4440eceb7be4b46}
\strng{fullhashraw}{3581ff1520adaf2bb4440eceb7be4b46}
\strng{bibnamehash}{9f67f65c7a3314e532e2c457dee12c49}
\strng{authorbibnamehash}{9f67f65c7a3314e532e2c457dee12c49}
\strng{authornamehash}{9f67f65c7a3314e532e2c457dee12c49}
\strng{authorfullhash}{3581ff1520adaf2bb4440eceb7be4b46}
\strng{authorfullhashraw}{3581ff1520adaf2bb4440eceb7be4b46}
\field{sortinit}{5}
\field{sortinithash}{20e9b4b0b173788c5dace24730f47d8c}
\field{labelnamesource}{author}
\field{labeltitlesource}{title}
\field{abstract}{How can intelligent agents solve a diverse set of tasks in a data-efficient manner? The disentangled representation learning approach posits that such an agent would benefit from separating out (disentangling) the underlying structure of the world into disjoint parts of its representation. However, there is no generally agreed-upon definition of disentangling, not least because it is unclear how to formalise the notion of world structure beyond toy datasets with a known ground truth generative process. Here we propose that a principled solution to characterising disentangled representations can be found by focusing on the transformation properties of the world. In particular, we suggest that those transformations that change only some properties of the underlying world state, while leaving all other properties invariant, are what gives exploitable structure to any kind of data. Similar ideas have already been successfully applied in physics, where the study of symmetry transformations has revolutionised the understanding of the world structure. By connecting symmetry transformations to vector representations using the formalism of group and representation theory we arrive at the first formal definition of disentangled representations. Our new definition is in agreement with many of the current intuitions about disentangling, while also providing principled resolutions to a number of previous points of contention. While this work focuses on formally defining disentangling - as opposed to solving the learning problem - we believe that the shift in perspective to studying data transformations can stimulate the development of better representation learning algorithms.}
\field{day}{5}
\field{eprinttype}{arxiv}
\field{month}{12}
\field{number}{{arXiv}:1812.02230}
\field{title}{Towards a Definition of Disentangled Representations}
\field{urlday}{23}
\field{urlmonth}{10}
\field{urlyear}{2024}
\field{year}{2018}
\field{dateera}{ce}
\field{urldateera}{ce}
\verb{doi}
\verb 10.48550/arXiv.1812.02230
\endverb
\verb{eprint}
\verb 1812.02230
\endverb
\verb{urlraw}
\verb http://arxiv.org/abs/1812.02230
\endverb
\verb{url}
\verb http://arxiv.org/abs/1812.02230
\endverb
\keyw{Computer Science - Machine Learning,Statistics - Machine Learning}
\endentry
\entry{scholkopf_causality_2019}{misc}{}{}
\name{author}{1}{}{%
{{hash=ca31cc11ec9370460148c3a9c48fce45}{%
family={Schölkopf},
familyi={S\bibinitperiod},
given={Bernhard},
giveni={B\bibinitperiod}}}%
}
\list{publisher}{1}{%
{arXiv}%
}
\strng{namehash}{ca31cc11ec9370460148c3a9c48fce45}
\strng{fullhash}{ca31cc11ec9370460148c3a9c48fce45}
\strng{fullhashraw}{ca31cc11ec9370460148c3a9c48fce45}
\strng{bibnamehash}{ca31cc11ec9370460148c3a9c48fce45}
\strng{authorbibnamehash}{ca31cc11ec9370460148c3a9c48fce45}
\strng{authornamehash}{ca31cc11ec9370460148c3a9c48fce45}
\strng{authorfullhash}{ca31cc11ec9370460148c3a9c48fce45}
\strng{authorfullhashraw}{ca31cc11ec9370460148c3a9c48fce45}
\field{sortinit}{5}
\field{sortinithash}{20e9b4b0b173788c5dace24730f47d8c}
\field{labelnamesource}{author}
\field{labeltitlesource}{title}
\field{abstract}{Graphical causal inference as pioneered by Judea Pearl arose from research on artificial intelligence ({AI}), and for a long time had little connection to the field of machine learning. This article discusses where links have been and should be established, introducing key concepts along the way. It argues that the hard open problems of machine learning and {AI} are intrinsically related to causality, and explains how the field is beginning to understand them.}
\field{day}{23}
\field{eprinttype}{arxiv}
\field{month}{12}
\field{number}{{arXiv}:1911.10500}
\field{title}{Causality for Machine Learning}
\field{urlday}{27}
\field{urlmonth}{10}
\field{urlyear}{2024}
\field{year}{2019}
\field{dateera}{ce}
\field{urldateera}{ce}
\verb{doi}
\verb 10.48550/arXiv.1911.10500
\endverb
\verb{eprint}
\verb 1911.10500
\endverb
\verb{urlraw}
\verb http://arxiv.org/abs/1911.10500
\endverb
\verb{url}
\verb http://arxiv.org/abs/1911.10500
\endverb
\keyw{Computer Science - Artificial Intelligence,Computer Science - Machine Learning,Statistics - Machine Learning}
\endentry
\entry{molnar2022}{book}{}{}
\name{author}{1}{}{%
{{hash=1519de263bd388a2ce312e7171b96d0d}{%
family={Molnar},
familyi={M\bibinitperiod},
given={Christoph},
giveni={C\bibinitperiod}}}%
}
\strng{namehash}{1519de263bd388a2ce312e7171b96d0d}
\strng{fullhash}{1519de263bd388a2ce312e7171b96d0d}
\strng{fullhashraw}{1519de263bd388a2ce312e7171b96d0d}
\strng{bibnamehash}{1519de263bd388a2ce312e7171b96d0d}
\strng{authorbibnamehash}{1519de263bd388a2ce312e7171b96d0d}
\strng{authornamehash}{1519de263bd388a2ce312e7171b96d0d}
\strng{authorfullhash}{1519de263bd388a2ce312e7171b96d0d}
\strng{authorfullhashraw}{1519de263bd388a2ce312e7171b96d0d}
\field{sortinit}{5}
\field{sortinithash}{20e9b4b0b173788c5dace24730f47d8c}
\field{labelnamesource}{author}
\field{labeltitlesource}{title}
\field{edition}{2}
\field{subtitle}{A Guide for Making Black Box Models Explainable}
\field{title}{Interpretable Machine Learning}
\field{year}{2022}
\verb{urlraw}
\verb https://christophm.github.io/interpretable-ml-book
\endverb
\verb{url}
\verb https://christophm.github.io/interpretable-ml-book
\endverb
\endentry
\entry{brown_language_2020}{inproceedings}{}{}
\name{author}{31}{}{%
{{hash=ad9f5a3d8c696d78ce2a831ce8ac7524}{%
family={Brown},
familyi={B\bibinitperiod},
given={Tom},
giveni={T\bibinitperiod}}}%
{{hash=d4543c3bcd6aaf414da4296b349603e5}{%
family={Mann},
familyi={M\bibinitperiod},
given={Benjamin},
giveni={B\bibinitperiod}}}%
{{hash=9ac58bd43db2434e8e1ffd6182c3fcda}{%
family={Ryder},
familyi={R\bibinitperiod},
given={Nick},
giveni={N\bibinitperiod}}}%
{{hash=9ed243177743da3e650f1cff6376bb3c}{%
family={Subbiah},
familyi={S\bibinitperiod},
given={Melanie},
giveni={M\bibinitperiod}}}%
{{hash=1e2dad58400c2dd6405837788e785d19}{%
family={Kaplan},
familyi={K\bibinitperiod},
given={Jared\bibnamedelima D},
giveni={J\bibinitperiod\bibinitdelim D\bibinitperiod}}}%
{{hash=4164e43d8cf919f5e3f8d80f5ea23f36}{%
family={Dhariwal},
familyi={D\bibinitperiod},
given={Prafulla},
giveni={P\bibinitperiod}}}%
{{hash=4ca421ceeb5b516dd8fc64bea5a23f2a}{%
family={Neelakantan},
familyi={N\bibinitperiod},
given={Arvind},
giveni={A\bibinitperiod}}}%
{{hash=ab5d7d7b9cfeaad635c4a60e8950d7dd}{%
family={Shyam},
familyi={S\bibinitperiod},
given={Pranav},
giveni={P\bibinitperiod}}}%
{{hash=3c1d9a663596faaf544c1a65aac581be}{%
family={Sastry},
familyi={S\bibinitperiod},
given={Girish},
giveni={G\bibinitperiod}}}%
{{hash=1e84eff933be9f4887bf369cf181bf12}{%
family={Askell},
familyi={A\bibinitperiod},
given={Amanda},
giveni={A\bibinitperiod}}}%
{{hash=abe4801e322e893b23785fd6d0800b5c}{%
family={Agarwal},
familyi={A\bibinitperiod},
given={Sandhini},
giveni={S\bibinitperiod}}}%
{{hash=787b9715a98ea66a8d5e6bae042ae0b9}{%
family={Herbert-Voss},
familyi={H\bibinithyphendelim V\bibinitperiod},
given={Ariel},
giveni={A\bibinitperiod}}}%
{{hash=c3a5cc5e520e0d1a9f8bbf377c74cd27}{%
family={Krueger},
familyi={K\bibinitperiod},
given={Gretchen},
giveni={G\bibinitperiod}}}%
{{hash=eb1d3044b466619459c76843f0e98bb9}{%
family={Henighan},
familyi={H\bibinitperiod},
given={Tom},
giveni={T\bibinitperiod}}}%
{{hash=5c2f5c2e6d4a9ec8681377f8a8e5e6af}{%
family={Child},
familyi={C\bibinitperiod},
given={Rewon},
giveni={R\bibinitperiod}}}%
{{hash=82063a12702e7b2c026ae0ff03b8f102}{%
family={Ramesh},
familyi={R\bibinitperiod},
given={Aditya},
giveni={A\bibinitperiod}}}%
{{hash=84650a9afb83d2e878b03bef608700cf}{%
family={Ziegler},
familyi={Z\bibinitperiod},
given={Daniel},
giveni={D\bibinitperiod}}}%
{{hash=495187f3a2c93ddb8083bd18a5702527}{%
family={Wu},
familyi={W\bibinitperiod},
given={Jeffrey},
giveni={J\bibinitperiod}}}%
{{hash=fdaff50f84c08440dcb5fad75b559780}{%
family={Winter},
familyi={W\bibinitperiod},
given={Clemens},
giveni={C\bibinitperiod}}}%
{{hash=07acc23f6ec051b64b82cd33255c0a69}{%
family={Hesse},
familyi={H\bibinitperiod},
given={Chris},
giveni={C\bibinitperiod}}}%
{{hash=fb15a691583ec94aafe0be6e7da4878f}{%
family={Chen},
familyi={C\bibinitperiod},
given={Mark},
giveni={M\bibinitperiod}}}%
{{hash=2a5f009f12a0567430729b5ace41435d}{%
family={Sigler},
familyi={S\bibinitperiod},
given={Eric},
giveni={E\bibinitperiod}}}%
{{hash=e5aa3a709cbe706efba113bec9789364}{%
family={Litwin},
familyi={L\bibinitperiod},
given={Mateusz},
giveni={M\bibinitperiod}}}%
{{hash=7006ca8c1ce969019b89de50fece60dd}{%
family={Gray},
familyi={G\bibinitperiod},
given={Scott},
giveni={S\bibinitperiod}}}%
{{hash=01f70651539bbd7dccc01e86ed9c78c3}{%
family={Chess},
familyi={C\bibinitperiod},
given={Benjamin},
giveni={B\bibinitperiod}}}%
{{hash=1480c861b1a73e1d1de1b227e985b179}{%
family={Clark},
familyi={C\bibinitperiod},
given={Jack},
giveni={J\bibinitperiod}}}%
{{hash=ca86811e7a0582a9e7cb8d33e7ab445d}{%
family={Berner},
familyi={B\bibinitperiod},
given={Christopher},
giveni={C\bibinitperiod}}}%
{{hash=b51e7c5fe92844f39ce52b8a5fa5675f}{%
family={{McCandlish}},
familyi={M\bibinitperiod},
given={Sam},
giveni={S\bibinitperiod}}}%
{{hash=a812c46caad94fc8701be37871f303ba}{%
family={Radford},
familyi={R\bibinitperiod},
given={Alec},
giveni={A\bibinitperiod}}}%
{{hash=8d569d1d5b8b5a7836017a98b430f959}{%
family={Sutskever},
familyi={S\bibinitperiod},
given={Ilya},
giveni={I\bibinitperiod}}}%
{{hash=1e6adbf36ab730cd5fdadb838b4d2667}{%
family={Amodei},
familyi={A\bibinitperiod},
given={Dario},
giveni={D\bibinitperiod}}}%
}
\list{publisher}{1}{%
{Curran Associates, Inc.}%
}
\strng{namehash}{85437fe07696e4c57f916c83d4ba5581}
\strng{fullhash}{28676992274ff1a4ebfa6e23ba7b2efd}
\strng{fullhashraw}{28676992274ff1a4ebfa6e23ba7b2efd}
\strng{bibnamehash}{85437fe07696e4c57f916c83d4ba5581}
\strng{authorbibnamehash}{85437fe07696e4c57f916c83d4ba5581}
\strng{authornamehash}{85437fe07696e4c57f916c83d4ba5581}
\strng{authorfullhash}{28676992274ff1a4ebfa6e23ba7b2efd}
\strng{authorfullhashraw}{28676992274ff1a4ebfa6e23ba7b2efd}
\field{sortinit}{7}
\field{sortinithash}{108d0be1b1bee9773a1173443802c0a3}
\field{labelnamesource}{author}
\field{labeltitlesource}{title}
\field{abstract}{We demonstrate that scaling up language models greatly improves task-agnostic, few-shot performance, sometimes even becoming competitive with prior state-of-the-art fine-tuning approaches. Specifically, we train {GPT}-3, an autoregressive language model with 175 billion parameters, 10x more than any previous non-sparse language model, and test its performance in the few-shot setting. For all tasks, {GPT}-3 is applied without any gradient updates or fine-tuning, with tasks and few-shot demonstrations specified purely via text interaction with the model. {GPT}-3 achieves strong performance on many {NLP} datasets, including translation, question-answering, and cloze tasks. We also identify some datasets where {GPT}-3's few-shot learning still struggles, as well as some datasets where {GPT}-3 faces methodological issues related to training on large web corpora.}
\field{booktitle}{Advances in Neural Information Processing Systems}
\field{title}{Language Models are Few-Shot Learners}
\field{urlday}{5}
\field{urlmonth}{11}
\field{urlyear}{2024}
\field{volume}{33}
\field{year}{2020}
\field{dateera}{ce}
\field{urldateera}{ce}
\field{pages}{1877\bibrangedash 1901}
\range{pages}{25}
\verb{urlraw}
\verb https://papers.nips.cc/paper/2020/hash/1457c0d6bfcb4967418bfb8ac142f64a-Abstract.html
\endverb
\verb{url}
\verb https://papers.nips.cc/paper/2020/hash/1457c0d6bfcb4967418bfb8ac142f64a-Abstract.html
\endverb
\endentry
\entry{ramesh_zero-shot_2021}{inproceedings}{}{}
\name{author}{8}{}{%
{{hash=82063a12702e7b2c026ae0ff03b8f102}{%
family={Ramesh},
familyi={R\bibinitperiod},
given={Aditya},
giveni={A\bibinitperiod}}}%
{{hash=136e03924aa309ddc55df5589dd1a186}{%
family={Pavlov},
familyi={P\bibinitperiod},
given={Mikhail},
giveni={M\bibinitperiod}}}%
{{hash=e5e3e996c0a95da7e97cae269822bbef}{%
family={Goh},
familyi={G\bibinitperiod},
given={Gabriel},
giveni={G\bibinitperiod}}}%
{{hash=7006ca8c1ce969019b89de50fece60dd}{%
family={Gray},
familyi={G\bibinitperiod},
given={Scott},
giveni={S\bibinitperiod}}}%
{{hash=d61a3404d468a166901fe17ffded7827}{%
family={Voss},
familyi={V\bibinitperiod},
given={Chelsea},
giveni={C\bibinitperiod}}}%
{{hash=a812c46caad94fc8701be37871f303ba}{%
family={Radford},
familyi={R\bibinitperiod},
given={Alec},
giveni={A\bibinitperiod}}}%
{{hash=fb15a691583ec94aafe0be6e7da4878f}{%
family={Chen},
familyi={C\bibinitperiod},
given={Mark},
giveni={M\bibinitperiod}}}%
{{hash=8d569d1d5b8b5a7836017a98b430f959}{%
family={Sutskever},
familyi={S\bibinitperiod},
given={Ilya},
giveni={I\bibinitperiod}}}%
}
\list{publisher}{1}{%
{PMLR}%
}
\strng{namehash}{01fa2e22064cfc88b7963c1f70eeaa5e}
\strng{fullhash}{5e712db8eb9120a52e12f164c8fb4e0a}
\strng{fullhashraw}{5e712db8eb9120a52e12f164c8fb4e0a}
\strng{bibnamehash}{01fa2e22064cfc88b7963c1f70eeaa5e}
\strng{authorbibnamehash}{01fa2e22064cfc88b7963c1f70eeaa5e}
\strng{authornamehash}{01fa2e22064cfc88b7963c1f70eeaa5e}
\strng{authorfullhash}{5e712db8eb9120a52e12f164c8fb4e0a}
\strng{authorfullhashraw}{5e712db8eb9120a52e12f164c8fb4e0a}
\field{sortinit}{7}
\field{sortinithash}{108d0be1b1bee9773a1173443802c0a3}
\field{labelnamesource}{author}
\field{labeltitlesource}{title}
\field{abstract}{Text-to-image generation has traditionally focused on finding better modeling assumptions for training on a fixed dataset. These assumptions might involve complex architectures, auxiliary losses, or side information such as object part labels or segmentation masks supplied during training. We describe a simple approach for this task based on a transformer that autoregressively models the text and image tokens as a single stream of data. With sufficient data and scale, our approach is competitive with previous domain-specific models when evaluated in a zero-shot fashion.}
\field{booktitle}{Proceedings of the 38th International Conference on Machine Learning}
\field{day}{1}
\field{eventtitle}{International Conference on Machine Learning}
\field{langid}{english}
\field{month}{7}
\field{note}{{ISSN}: 2640-3498}
\field{title}{Zero-Shot Text-to-Image Generation}
\field{urlday}{5}
\field{urlmonth}{11}
\field{urlyear}{2024}
\field{year}{2021}
\field{dateera}{ce}
\field{urldateera}{ce}
\field{pages}{8821\bibrangedash 8831}
\range{pages}{11}
\verb{urlraw}
\verb https://proceedings.mlr.press/v139/ramesh21a.html
\endverb
\verb{url}
\verb https://proceedings.mlr.press/v139/ramesh21a.html
\endverb
\endentry
\entry{makrodimitris_-depth_2024}{article}{}{}
\name{author}{4}{}{%
{{hash=40290fb751ec69e868e6e5816eba0880}{%
family={Makrodimitris},
familyi={M\bibinitperiod},
given={Stavros},
giveni={S\bibinitperiod}}}%
{{hash=f972c2bb510d141e5dbe691dc76fed89}{%
family={Pronk},
familyi={P\bibinitperiod},
given={Bram},
giveni={B\bibinitperiod}}}%
{{hash=39cc0e3742199ed1c3218d76fb99e143}{%
family={Abdelaal},
familyi={A\bibinitperiod},
given={Tamim},
giveni={T\bibinitperiod}}}%
{{hash=b163e2892cb36565e1c38d7164ab5968}{%
family={Reinders},
familyi={R\bibinitperiod},
given={Marcel},
giveni={M\bibinitperiod}}}%
}
\strng{namehash}{e418bfaccdb2e4c6428d324af0d06cc8}
\strng{fullhash}{f086adf2b88813b047732544f7f9b4f2}
\strng{fullhashraw}{f086adf2b88813b047732544f7f9b4f2}
\strng{bibnamehash}{e418bfaccdb2e4c6428d324af0d06cc8}
\strng{authorbibnamehash}{e418bfaccdb2e4c6428d324af0d06cc8}
\strng{authornamehash}{e418bfaccdb2e4c6428d324af0d06cc8}
\strng{authorfullhash}{f086adf2b88813b047732544f7f9b4f2}
\strng{authorfullhashraw}{f086adf2b88813b047732544f7f9b4f2}
\field{sortinit}{7}
\field{sortinithash}{108d0be1b1bee9773a1173443802c0a3}
\field{labelnamesource}{author}
\field{labeltitlesource}{title}
\field{abstract}{Multi-omic analyses are necessary to understand the complex biological processes taking place at the tissue and cell level, but also to make reliable predictions about, for example, disease outcome. Several linear methods exist that create a joint embedding using paired information per sample, but recently there has been a rise in the popularity of neural architectures that embed paired -omics into the same non-linear manifold. This work describes a head-to-head comparison of linear and non-linear joint embedding methods using both bulk and single-cell multi-modal datasets. We found that non-linear methods have a clear advantage with respect to linear ones for missing modality imputation. Performance comparisons in the downstream tasks of survival analysis for bulk tumor data and cell type classification for single-cell data lead to the following insights: First, concatenating the principal components of each modality is a competitive baseline and hard to beat if all modalities are available at test time. However, if we only have one modality available at test time, training a predictive model on the joint space of that modality can lead to performance improvements with respect to just using the unimodal principal components. Second, -omic profiles imputed by neural joint embedding methods are realistic enough to be used by a classifier trained on real data with limited performance drops. Taken together, our comparisons give hints to which joint embedding to use for which downstream task. Overall, product-of-experts performed well in most tasks and was reasonably fast, while early integration (concatenation) of modalities did quite poorly.}
\field{day}{1}
\field{issn}{1477-4054}
\field{journaltitle}{Briefings in Bioinformatics}
\field{month}{1}
\field{number}{1}
\field{shortjournal}{Briefings in Bioinformatics}
\field{title}{An in-depth comparison of linear and non-linear joint embedding methods for bulk and single-cell multi-omics}
\field{urlday}{31}
\field{urlmonth}{10}
\field{urlyear}{2024}
\field{volume}{25}
\field{year}{2024}
\field{dateera}{ce}
\field{urldateera}{ce}
\field{pages}{bbad416}
\range{pages}{-1}
\verb{doi}
\verb 10.1093/bib/bbad416
\endverb
\verb{urlraw}
\verb https://doi.org/10.1093/bib/bbad416
\endverb
\verb{url}
\verb https://doi.org/10.1093/bib/bbad416
\endverb
\endentry
\entry{kobak_art_2019}{article}{}{}
\name{author}{2}{}{%
{{hash=85a42394eb715e476e39053e10dcf052}{%
family={Kobak},
familyi={K\bibinitperiod},
given={Dmitry},
giveni={D\bibinitperiod}}}%
{{hash=30f46bf5fd8b18adc9707a70cec598b6}{%
family={Berens},
familyi={B\bibinitperiod},
given={Philipp},
giveni={P\bibinitperiod}}}%
}
\strng{namehash}{a809b1fdb52f81e8d84998c974a3bc39}
\strng{fullhash}{a809b1fdb52f81e8d84998c974a3bc39}
\strng{fullhashraw}{a809b1fdb52f81e8d84998c974a3bc39}
\strng{bibnamehash}{a809b1fdb52f81e8d84998c974a3bc39}
\strng{authorbibnamehash}{a809b1fdb52f81e8d84998c974a3bc39}
\strng{authornamehash}{a809b1fdb52f81e8d84998c974a3bc39}
\strng{authorfullhash}{a809b1fdb52f81e8d84998c974a3bc39}
\strng{authorfullhashraw}{a809b1fdb52f81e8d84998c974a3bc39}
\field{sortinit}{7}
\field{sortinithash}{108d0be1b1bee9773a1173443802c0a3}
\field{labelnamesource}{author}
\field{labeltitlesource}{title}
\field{abstract}{Single-cell transcriptomics yields ever growing data sets containing {RNA} expression levels for thousands of genes from up to millions of cells. Common data analysis pipelines include a dimensionality reduction step for visualising the data in two dimensions, most frequently performed using t-distributed stochastic neighbour embedding (t-{SNE}). It excels at revealing local structure in high-dimensional data, but naive applications often suffer from severe shortcomings, e.g. the global structure of the data is not represented accurately. Here we describe how to circumvent such pitfalls, and develop a protocol for creating more faithful t-{SNE} visualisations. It includes {PCA} initialisation, a high learning rate, and multi-scale similarity kernels; for very large data sets, we additionally use exaggeration and downsampling-based initialisation. We use published single-cell {RNA}-seq data sets to demonstrate that this protocol yields superior results compared to the naive application of t-{SNE}.}
\field{day}{28}
\field{issn}{2041-1723}
\field{journaltitle}{Nature Communications}
\field{langid}{english}
\field{month}{11}
\field{note}{Publisher: Nature Publishing Group}
\field{number}{1}
\field{shortjournal}{Nat Commun}
\field{title}{The art of using t-{SNE} for single-cell transcriptomics}
\field{urlday}{10}
\field{urlmonth}{11}
\field{urlyear}{2024}
\field{volume}{10}
\field{year}{2019}
\field{dateera}{ce}
\field{urldateera}{ce}
\field{pages}{5416}
\range{pages}{1}
\verb{doi}
\verb 10.1038/s41467-019-13056-x
\endverb
\verb{urlraw}
\verb https://www.nature.com/articles/s41467-019-13056-x
\endverb
\verb{url}
\verb https://www.nature.com/articles/s41467-019-13056-x
\endverb
\keyw{{RNA} sequencing,Statistics}
\endentry
\entry{bommasani_opportunities_2022}{misc}{}{}
\name{author}{114}{}{%
{{hash=3963a2fcc8de83e028bc855365b882d9}{%
family={Bommasani},
familyi={B\bibinitperiod},
given={Rishi},
giveni={R\bibinitperiod}}}%
{{hash=b2756a270aa1e5d4a20fa3ed9b6e1f8c}{%
family={Hudson},
familyi={H\bibinitperiod},
given={Drew\bibnamedelima A.},
giveni={D\bibinitperiod\bibinitdelim A\bibinitperiod}}}%
{{hash=91a5d92d019d0302b9a66aa6ba4b1bc8}{%
family={Adeli},
familyi={A\bibinitperiod},
given={Ehsan},
giveni={E\bibinitperiod}}}%
{{hash=e8fc96447f9340e4184d491b95fce5a5}{%
family={Altman},
familyi={A\bibinitperiod},
given={Russ},
giveni={R\bibinitperiod}}}%
{{hash=3ffe90aedf033aa6eb6d5c26bced7177}{%
family={Arora},
familyi={A\bibinitperiod},
given={Simran},
giveni={S\bibinitperiod}}}%
{{hash=000a6cbf8aca9234835772b7972b889f}{%
family={Arx},
familyi={A\bibinitperiod},
given={Sydney\bibnamedelima von},
giveni={S\bibinitperiod\bibinitdelim v\bibinitperiod}}}%
{{hash=bb1df70dce464605ddd9cf83485d8db1}{%
family={Bernstein},
familyi={B\bibinitperiod},
given={Michael\bibnamedelima S.},
giveni={M\bibinitperiod\bibinitdelim S\bibinitperiod}}}%
{{hash=49e0ca937af486456ef5f0603eafb7dc}{%
family={Bohg},
familyi={B\bibinitperiod},
given={Jeannette},
giveni={J\bibinitperiod}}}%
{{hash=ed22853aa493ba4023443a010c9f6f8b}{%
family={Bosselut},
familyi={B\bibinitperiod},
given={Antoine},
giveni={A\bibinitperiod}}}%
{{hash=d94fdf38ad71e8210b4505c8fbb7fa87}{%
family={Brunskill},
familyi={B\bibinitperiod},
given={Emma},
giveni={E\bibinitperiod}}}%
{{hash=7bd9f54569cb8c0301da00ed49b5a752}{%
family={Brynjolfsson},
familyi={B\bibinitperiod},
given={Erik},
giveni={E\bibinitperiod}}}%
{{hash=af31d8923236f1a7e9a0df8b744d2d55}{%
family={Buch},
familyi={B\bibinitperiod},
given={Shyamal},
giveni={S\bibinitperiod}}}%
{{hash=65c8e5336738df29fabfe51e91d52c3b}{%
family={Card},
familyi={C\bibinitperiod},
given={Dallas},
giveni={D\bibinitperiod}}}%
{{hash=392132fc28203fa2ae31b59cf05b0c7a}{%
family={Castellon},
familyi={C\bibinitperiod},
given={Rodrigo},
giveni={R\bibinitperiod}}}%
{{hash=ef6ded1d36f3b5b10bb5f2447bc40818}{%
family={Chatterji},
familyi={C\bibinitperiod},
given={Niladri},
giveni={N\bibinitperiod}}}%
{{hash=2fe24d54b2fea8307a1f608cd0d97174}{%
family={Chen},
familyi={C\bibinitperiod},
given={Annie},
giveni={A\bibinitperiod}}}%
{{hash=0b13ebd89013d6c24d2c6e82545a0cd8}{%
family={Creel},
familyi={C\bibinitperiod},
given={Kathleen},
giveni={K\bibinitperiod}}}%
{{hash=e7ca1a184acbd133d9c401f184441c69}{%
family={Davis},
familyi={D\bibinitperiod},
given={Jared\bibnamedelima Quincy},
giveni={J\bibinitperiod\bibinitdelim Q\bibinitperiod}}}%
{{hash=4aade6eed920a6b296d0230dbd4706a5}{%
family={Demszky},
familyi={D\bibinitperiod},
given={Dora},
giveni={D\bibinitperiod}}}%
{{hash=a53bb69fcb99ecc1daaa649ffe82ca5c}{%
family={Donahue},
familyi={D\bibinitperiod},
given={Chris},
giveni={C\bibinitperiod}}}%
{{hash=9d1efdb590f09cc2d86d91fe65b21dd5}{%
family={Doumbouya},
familyi={D\bibinitperiod},
given={Moussa},
giveni={M\bibinitperiod}}}%
{{hash=fb99a22b9a7e4d6e6827455fa420fc5f}{%
family={Durmus},
familyi={D\bibinitperiod},
given={Esin},
giveni={E\bibinitperiod}}}%
{{hash=160929a7e6ceecdf3f7c9a13abd5ea35}{%
family={Ermon},
familyi={E\bibinitperiod},
given={Stefano},
giveni={S\bibinitperiod}}}%
{{hash=60b817775846213e2bec953071cfba95}{%
family={Etchemendy},
familyi={E\bibinitperiod},
given={John},
giveni={J\bibinitperiod}}}%
{{hash=5e0326e7704dfc4d1bc0ad89e1192f67}{%
family={Ethayarajh},
familyi={E\bibinitperiod},
given={Kawin},
giveni={K\bibinitperiod}}}%
{{hash=cd00ce5bc45f687c432e52e0fa1a7aa6}{%
family={Fei-Fei},
familyi={F\bibinithyphendelim F\bibinitperiod},
given={Li},
giveni={L\bibinitperiod}}}%
{{hash=058e82495825ae376c6a96a12169e6ee}{%
family={Finn},
familyi={F\bibinitperiod},
given={Chelsea},
giveni={C\bibinitperiod}}}%
{{hash=c7fc2ec4e4f0cbfedeff8c8a385eeb90}{%
family={Gale},
familyi={G\bibinitperiod},
given={Trevor},
giveni={T\bibinitperiod}}}%
{{hash=240ae9ab7eae3e2d948d764d2f55d6ec}{%
family={Gillespie},
familyi={G\bibinitperiod},
given={Lauren},
giveni={L\bibinitperiod}}}%
{{hash=b28818adf394a54c714e3a5c8313377e}{%
family={Goel},
familyi={G\bibinitperiod},
given={Karan},
giveni={K\bibinitperiod}}}%
{{hash=d98a11597b0645b5e5c970ce0a562a96}{%
family={Goodman},
familyi={G\bibinitperiod},
given={Noah},
giveni={N\bibinitperiod}}}%
{{hash=4eed4dfc949da3211d651ebd8c4c670b}{%
family={Grossman},
familyi={G\bibinitperiod},
given={Shelby},
giveni={S\bibinitperiod}}}%
{{hash=5c5188998b64714185b6cc228eb9a4fd}{%
family={Guha},
familyi={G\bibinitperiod},
given={Neel},
giveni={N\bibinitperiod}}}%
{{hash=be228979341f812e59d6e0fe757fe105}{%
family={Hashimoto},
familyi={H\bibinitperiod},
given={Tatsunori},
giveni={T\bibinitperiod}}}%
{{hash=50374f86d34cc54b8a5788ccbcce4cfe}{%
family={Henderson},
familyi={H\bibinitperiod},
given={Peter},
giveni={P\bibinitperiod}}}%
{{hash=8d557c63d5d40248206f4499cd9ac310}{%
family={Hewitt},
familyi={H\bibinitperiod},
given={John},
giveni={J\bibinitperiod}}}%
{{hash=2e146a981c17f3c9b6f92736f5fde3c1}{%
family={Ho},
familyi={H\bibinitperiod},
given={Daniel\bibnamedelima E.},
giveni={D\bibinitperiod\bibinitdelim E\bibinitperiod}}}%
{{hash=faf318ef4acda4567253c563b330f7ff}{%
family={Hong},
familyi={H\bibinitperiod},
given={Jenny},
giveni={J\bibinitperiod}}}%
{{hash=78e1c9958ee71476268e13a238fae1e5}{%
family={Hsu},
familyi={H\bibinitperiod},
given={Kyle},
giveni={K\bibinitperiod}}}%
{{hash=dc6a25244d65d1c3b76b8da8ba84b54c}{%
family={Huang},
familyi={H\bibinitperiod},
given={Jing},
giveni={J\bibinitperiod}}}%
{{hash=b0badbf499a1ef5e7bc2f893186e6a5c}{%
family={Icard},
familyi={I\bibinitperiod},
given={Thomas},
giveni={T\bibinitperiod}}}%
{{hash=acdd7450ea2182de698a25065127e049}{%
family={Jain},
familyi={J\bibinitperiod},
given={Saahil},
giveni={S\bibinitperiod}}}%
{{hash=3147296c99a3f829087becd1a4eaec08}{%
family={Jurafsky},
familyi={J\bibinitperiod},
given={Dan},
giveni={D\bibinitperiod}}}%
{{hash=4b08aa37d9caa8d3d167a189b7fdabdc}{%
family={Kalluri},
familyi={K\bibinitperiod},
given={Pratyusha},
giveni={P\bibinitperiod}}}%
{{hash=0cf3ec76164d190258b742372fecf5af}{%
family={Karamcheti},
familyi={K\bibinitperiod},
given={Siddharth},
giveni={S\bibinitperiod}}}%
{{hash=f26de96c576b2e86930c2310426c0e1d}{%
family={Keeling},
familyi={K\bibinitperiod},
given={Geoff},
giveni={G\bibinitperiod}}}%
{{hash=cce7236c358c86293a63037af2316088}{%
family={Khani},
familyi={K\bibinitperiod},
given={Fereshte},
giveni={F\bibinitperiod}}}%
{{hash=7c1f69df368375faab52ad37587dfd85}{%
family={Khattab},
familyi={K\bibinitperiod},
given={Omar},
giveni={O\bibinitperiod}}}%
{{hash=b7309d5979903f9e56ec43ebf0d594ad}{%
family={Koh},
familyi={K\bibinitperiod},
given={Pang\bibnamedelima Wei},
giveni={P\bibinitperiod\bibinitdelim W\bibinitperiod}}}%
{{hash=4a65f24db77dbeffe37e9a16299dbafe}{%
family={Krass},
familyi={K\bibinitperiod},
given={Mark},
giveni={M\bibinitperiod}}}%
{{hash=e9cf8ade7c94f1084ea6832928a36fef}{%
family={Krishna},
familyi={K\bibinitperiod},
given={Ranjay},
giveni={R\bibinitperiod}}}%
{{hash=e8a00cdf6113b597eb2a9766a7b801fb}{%
family={Kuditipudi},
familyi={K\bibinitperiod},
given={Rohith},
giveni={R\bibinitperiod}}}%
{{hash=1047181628ae2fc1a1cf6271af00ce82}{%
family={Kumar},
familyi={K\bibinitperiod},
given={Ananya},
giveni={A\bibinitperiod}}}%
{{hash=ced0403c07861802e74bf36cea3d1460}{%
family={Ladhak},
familyi={L\bibinitperiod},
given={Faisal},
giveni={F\bibinitperiod}}}%
{{hash=27d62aaa219df51eaa434fbedee686b4}{%
family={Lee},
familyi={L\bibinitperiod},
given={Mina},
giveni={M\bibinitperiod}}}%
{{hash=75502ac96d1848352bed21df4be905a0}{%
family={Lee},
familyi={L\bibinitperiod},
given={Tony},
giveni={T\bibinitperiod}}}%
{{hash=900d107125ff0ca84698cb909e4f6c51}{%
family={Leskovec},
familyi={L\bibinitperiod},
given={Jure},
giveni={J\bibinitperiod}}}%
{{hash=1a3f3794d6fe2b30f59da78d4d7036b1}{%
family={Levent},
familyi={L\bibinitperiod},
given={Isabelle},
giveni={I\bibinitperiod}}}%
{{hash=3e100909d77fa0e509e19ac0b35b6306}{%
family={Li},
familyi={L\bibinitperiod},
given={Xiang\bibnamedelima Lisa},
giveni={X\bibinitperiod\bibinitdelim L\bibinitperiod}}}%
{{hash=b15f49c62474eb455b840b4fd198e965}{%
family={Li},
familyi={L\bibinitperiod},
given={Xuechen},
giveni={X\bibinitperiod}}}%
{{hash=5bd4a91e09b499d15e82bc929acf1e34}{%
family={Ma},
familyi={M\bibinitperiod},
given={Tengyu},
giveni={T\bibinitperiod}}}%
{{hash=644cd66cda9a4ffbe195d6884eb9da21}{%
family={Malik},
familyi={M\bibinitperiod},
given={Ali},
giveni={A\bibinitperiod}}}%
{{hash=2214edb8305f7ccd7cdc310b3a8ae1b4}{%
family={Manning},
familyi={M\bibinitperiod},
given={Christopher\bibnamedelima D.},
giveni={C\bibinitperiod\bibinitdelim D\bibinitperiod}}}%
{{hash=9efbf4a9894da6afdb78d41966429558}{%
family={Mirchandani},
familyi={M\bibinitperiod},
given={Suvir},
giveni={S\bibinitperiod}}}%
{{hash=b9441ad4287a1b5f251258a6fd6afb3a}{%
family={Mitchell},
familyi={M\bibinitperiod},
given={Eric},
giveni={E\bibinitperiod}}}%
{{hash=3897179e7392bf966ae8398b2607acae}{%
family={Munyikwa},
familyi={M\bibinitperiod},
given={Zanele},
giveni={Z\bibinitperiod}}}%
{{hash=df590fc759747c7e8bfe23768561e640}{%
family={Nair},
familyi={N\bibinitperiod},
given={Suraj},
giveni={S\bibinitperiod}}}%
{{hash=8af4e4ca915f01ba9eebacf5762a5542}{%
family={Narayan},
familyi={N\bibinitperiod},
given={Avanika},
giveni={A\bibinitperiod}}}%
{{hash=b34c3675fa6935732be9302df09d61e7}{%
family={Narayanan},
familyi={N\bibinitperiod},
given={Deepak},
giveni={D\bibinitperiod}}}%
{{hash=ddb6b648f08c540de2055befac601da3}{%
family={Newman},
familyi={N\bibinitperiod},
given={Ben},
giveni={B\bibinitperiod}}}%
{{hash=f236bd1ea193b63083b7b8f9a6693fab}{%
family={Nie},
familyi={N\bibinitperiod},
given={Allen},
giveni={A\bibinitperiod}}}%
{{hash=0e3d5d93aebbb520ce0d66f1493e3182}{%
family={Niebles},
familyi={N\bibinitperiod},
given={Juan\bibnamedelima Carlos},
giveni={J\bibinitperiod\bibinitdelim C\bibinitperiod}}}%
{{hash=a4b30e51359854c0d89aa15a6279a424}{%
family={Nilforoshan},
familyi={N\bibinitperiod},
given={Hamed},
giveni={H\bibinitperiod}}}%
{{hash=f9610120104f363e5e025e37f0481a00}{%
family={Nyarko},
familyi={N\bibinitperiod},
given={Julian},
giveni={J\bibinitperiod}}}%
{{hash=d533c61283c37125fbd7dff715b3b13b}{%
family={Ogut},
familyi={O\bibinitperiod},
given={Giray},
giveni={G\bibinitperiod}}}%
{{hash=56609998fd4fad40ac1db49f3bf74a71}{%
family={Orr},
familyi={O\bibinitperiod},
given={Laurel},
giveni={L\bibinitperiod}}}%
{{hash=ab1d41a4277989255e218a39ef990918}{%
family={Papadimitriou},
familyi={P\bibinitperiod},
given={Isabel},
giveni={I\bibinitperiod}}}%
{{hash=a6d2d4802375c9b3367011ada5e50822}{%
family={Park},
familyi={P\bibinitperiod},
given={Joon\bibnamedelima Sung},
giveni={J\bibinitperiod\bibinitdelim S\bibinitperiod}}}%
{{hash=329b34d0a2be175814c185a16c2314fc}{%
family={Piech},
familyi={P\bibinitperiod},
given={Chris},
giveni={C\bibinitperiod}}}%
{{hash=ddcb5844dd617114f2e297527ab57781}{%
family={Portelance},
familyi={P\bibinitperiod},
given={Eva},
giveni={E\bibinitperiod}}}%
{{hash=699d626ef41a1a827d623529c1a45e5a}{%
family={Potts},
familyi={P\bibinitperiod},
given={Christopher},
giveni={C\bibinitperiod}}}%
{{hash=7bb584b014f043d94e43a8395735799e}{%
family={Raghunathan},
familyi={R\bibinitperiod},
given={Aditi},
giveni={A\bibinitperiod}}}%
{{hash=59d55d52c7b75f92715c4f7d81be2940}{%
family={Reich},
familyi={R\bibinitperiod},
given={Rob},
giveni={R\bibinitperiod}}}%
{{hash=f136c99c06f10d114554179d4722b864}{%
family={Ren},
familyi={R\bibinitperiod},
given={Hongyu},
giveni={H\bibinitperiod}}}%
{{hash=b645d37e24a7c66bcf7a6422ecbbad15}{%
family={Rong},
familyi={R\bibinitperiod},
given={Frieda},
giveni={F\bibinitperiod}}}%
{{hash=0c985a6824f10b568d5b3a5db148a9f0}{%
family={Roohani},
familyi={R\bibinitperiod},
given={Yusuf},
giveni={Y\bibinitperiod}}}%
{{hash=af87918b9edf77ea2ebe3722099ea779}{%
family={Ruiz},
familyi={R\bibinitperiod},
given={Camilo},
giveni={C\bibinitperiod}}}%
{{hash=9ac8a375a7855a6db42abb4107d7ea4e}{%
family={Ryan},
familyi={R\bibinitperiod},
given={Jack},
giveni={J\bibinitperiod}}}%
{{hash=eb1f5a2ba08ea12db36c871fe601f5f1}{%
family={Ré},
familyi={R\bibinitperiod},
given={Christopher},
giveni={C\bibinitperiod}}}%
{{hash=ad742818738efaa3c358f9def3944504}{%
family={Sadigh},
familyi={S\bibinitperiod},
given={Dorsa},
giveni={D\bibinitperiod}}}%
{{hash=7a0090b3fe3fd8202defc8955e942abb}{%
family={Sagawa},
familyi={S\bibinitperiod},
given={Shiori},
giveni={S\bibinitperiod}}}%
{{hash=d592c130d7c5ac98ff68ac9690dae0d0}{%
family={Santhanam},
familyi={S\bibinitperiod},
given={Keshav},
giveni={K\bibinitperiod}}}%
{{hash=a7b4dd0087a3c49f89ad850cb8bede41}{%
family={Shih},
familyi={S\bibinitperiod},
given={Andy},
giveni={A\bibinitperiod}}}%
{{hash=402d4f01c8bc2ccf3772e8538e4d4a6d}{%
family={Srinivasan},
familyi={S\bibinitperiod},
given={Krishnan},
giveni={K\bibinitperiod}}}%
{{hash=1209f7e3599bd390bab72d9cca887763}{%
family={Tamkin},
familyi={T\bibinitperiod},
given={Alex},
giveni={A\bibinitperiod}}}%
{{hash=9590cdbe06768705c6571bce7802fcc2}{%
family={Taori},
familyi={T\bibinitperiod},
given={Rohan},
giveni={R\bibinitperiod}}}%
{{hash=7bc57e0261c064c9e837697f8b5fc22e}{%
family={Thomas},
familyi={T\bibinitperiod},
given={Armin\bibnamedelima W.},
giveni={A\bibinitperiod\bibinitdelim W\bibinitperiod}}}%
{{hash=ab482c2931db00ecd5b1e89bbe011cb5}{%
family={Tramèr},
familyi={T\bibinitperiod},
given={Florian},
giveni={F\bibinitperiod}}}%
{{hash=de94dfef4697a78dc56ab69c23558df5}{%
family={Wang},
familyi={W\bibinitperiod},
given={Rose\bibnamedelima E.},
giveni={R\bibinitperiod\bibinitdelim E\bibinitperiod}}}%
{{hash=f547ec885594e76da25ad82058ba8850}{%
family={Wang},
familyi={W\bibinitperiod},
given={William},
giveni={W\bibinitperiod}}}%
{{hash=8680ef845bbdd349f96424ad986a47f8}{%
family={Wu},
familyi={W\bibinitperiod},
given={Bohan},
giveni={B\bibinitperiod}}}%
{{hash=3a7d08fff1af967fe4513ac63790e97d}{%
family={Wu},
familyi={W\bibinitperiod},
given={Jiajun},
giveni={J\bibinitperiod}}}%
{{hash=954bef435a12336c9decd19360a640f5}{%
family={Wu},
familyi={W\bibinitperiod},
given={Yuhuai},
giveni={Y\bibinitperiod}}}%
{{hash=3e4a7fd97d3e0bb7770a140ba997150f}{%
family={Xie},
familyi={X\bibinitperiod},
given={Sang\bibnamedelima Michael},
giveni={S\bibinitperiod\bibinitdelim M\bibinitperiod}}}%
{{hash=f95714ad66afcfa71b317b3bec07d01d}{%
family={Yasunaga},
familyi={Y\bibinitperiod},
given={Michihiro},
giveni={M\bibinitperiod}}}%
{{hash=adf64964c8c9d5f144d937e11ccf61ba}{%
family={You},
familyi={Y\bibinitperiod},
given={Jiaxuan},
giveni={J\bibinitperiod}}}%
{{hash=00dc518b94dfa6349c86e70661a1a5ef}{%
family={Zaharia},
familyi={Z\bibinitperiod},
given={Matei},
giveni={M\bibinitperiod}}}%
{{hash=3214f9487d07db5ea11795e7d6ea416d}{%
family={Zhang},
familyi={Z\bibinitperiod},
given={Michael},
giveni={M\bibinitperiod}}}%
{{hash=733e3732b7e3ce5cf2b04cf5e9bd9cf1}{%
family={Zhang},
familyi={Z\bibinitperiod},
given={Tianyi},
giveni={T\bibinitperiod}}}%
{{hash=0062b3d93aad0fef37c9aa27dc6d165b}{%
family={Zhang},
familyi={Z\bibinitperiod},
given={Xikun},
giveni={X\bibinitperiod}}}%
{{hash=4a029fd7cea6a9c680cd411bbb8ad43c}{%
family={Zhang},
familyi={Z\bibinitperiod},
given={Yuhui},
giveni={Y\bibinitperiod}}}%
{{hash=3c6953622ba83af60dc476561349a5b8}{%
family={Zheng},
familyi={Z\bibinitperiod},
given={Lucia},
giveni={L\bibinitperiod}}}%
{{hash=d123e225dfb2478fcb0d08b27c81491b}{%
family={Zhou},
familyi={Z\bibinitperiod},
given={Kaitlyn},
giveni={K\bibinitperiod}}}%
{{hash=86c032bbc45c3b616f0a1170befc0e82}{%
family={Liang},
familyi={L\bibinitperiod},
given={Percy},
giveni={P\bibinitperiod}}}%
}
\list{publisher}{1}{%
{arXiv}%
}
\strng{namehash}{e1331c79138f819881e39bc36f1b80e0}
\strng{fullhash}{38016a5c6e9130115c95746c93874ec8}
\strng{fullhashraw}{38016a5c6e9130115c95746c93874ec8}
\strng{bibnamehash}{e1331c79138f819881e39bc36f1b80e0}
\strng{authorbibnamehash}{e1331c79138f819881e39bc36f1b80e0}
\strng{authornamehash}{e1331c79138f819881e39bc36f1b80e0}
\strng{authorfullhash}{38016a5c6e9130115c95746c93874ec8}
\strng{authorfullhashraw}{38016a5c6e9130115c95746c93874ec8}
\field{sortinit}{8}
\field{sortinithash}{a231b008ebf0ecbe0b4d96dcc159445f}
\field{labelnamesource}{author}
\field{labeltitlesource}{title}
\field{abstract}{{AI} is undergoing a paradigm shift with the rise of models (e.g., {BERT}, {DALL}-E, {GPT}-3) that are trained on broad data at scale and are adaptable to a wide range of downstream tasks. We call these models foundation models to underscore their critically central yet incomplete character. This report provides a thorough account of the opportunities and risks of foundation models, ranging from their capabilities (e.g., language, vision, robotics, reasoning, human interaction) and technical principles(e.g., model architectures, training procedures, data, systems, security, evaluation, theory) to their applications (e.g., law, healthcare, education) and societal impact (e.g., inequity, misuse, economic and environmental impact, legal and ethical considerations). Though foundation models are based on standard deep learning and transfer learning, their scale results in new emergent capabilities,and their effectiveness across so many tasks incentivizes homogenization. Homogenization provides powerful leverage but demands caution, as the defects of the foundation model are inherited by all the adapted models downstream. Despite the impending widespread deployment of foundation models, we currently lack a clear understanding of how they work, when they fail, and what they are even capable of due to their emergent properties. To tackle these questions, we believe much of the critical research on foundation models will require deep interdisciplinary collaboration commensurate with their fundamentally sociotechnical nature.}
\field{day}{12}
\field{eprinttype}{arxiv}
\field{month}{7}
\field{number}{{arXiv}:2108.07258}
\field{title}{On the Opportunities and Risks of Foundation Models}
\field{urlday}{4}
\field{urlmonth}{5}
\field{urlyear}{2025}
\field{year}{2022}
\field{dateera}{ce}
\field{urldateera}{ce}
\verb{doi}
\verb 10.48550/arXiv.2108.07258
\endverb
\verb{eprint}
\verb 2108.07258 [cs]
\endverb
\verb{urlraw}
\verb http://arxiv.org/abs/2108.07258
\endverb
\verb{url}
\verb http://arxiv.org/abs/2108.07258
\endverb
\keyw{Computer Science - Artificial Intelligence,Computer Science - Computers and Society,Computer Science - Machine Learning}
\endentry
\entry{brbic_annotation_2022}{article}{}{}
\name{author}{7}{}{%
{{hash=98d67bf0c3f188212d65b33dca9c20d7}{%
family={Brbić},
familyi={B\bibinitperiod},
given={Maria},
giveni={M\bibinitperiod}}}%
{{hash=154615b7c020b8f4795a4d5060f73707}{%
family={Cao},
familyi={C\bibinitperiod},
given={Kaidi},
giveni={K\bibinitperiod}}}%
{{hash=e1ff4a4c1b6ee8b2efa5e8b8d05c649e}{%
family={Hickey},
familyi={H\bibinitperiod},
given={John\bibnamedelima W.},
giveni={J\bibinitperiod\bibinitdelim W\bibinitperiod}}}%
{{hash=ce25c714837782f3791be27754fa520c}{%
family={Tan},
familyi={T\bibinitperiod},
given={Yuqi},
giveni={Y\bibinitperiod}}}%
{{hash=402e19a2cdcaaacd69158cdabd72bf86}{%
family={Snyder},
familyi={S\bibinitperiod},
given={Michael\bibnamedelima P.},
giveni={M\bibinitperiod\bibinitdelim P\bibinitperiod}}}%
{{hash=099a30e89ac61c4af0fcea7f58aa1f1f}{%
family={Nolan},
familyi={N\bibinitperiod},
given={Garry\bibnamedelima P.},
giveni={G\bibinitperiod\bibinitdelim P\bibinitperiod}}}%
{{hash=900d107125ff0ca84698cb909e4f6c51}{%
family={Leskovec},
familyi={L\bibinitperiod},
given={Jure},
giveni={J\bibinitperiod}}}%
}
\strng{namehash}{19ea34234f6709bf7fb4280ead234111}
\strng{fullhash}{d96564254a1a56b37f2560514ccee836}
\strng{fullhashraw}{d96564254a1a56b37f2560514ccee836}
\strng{bibnamehash}{19ea34234f6709bf7fb4280ead234111}
\strng{authorbibnamehash}{19ea34234f6709bf7fb4280ead234111}
\strng{authornamehash}{19ea34234f6709bf7fb4280ead234111}
\strng{authorfullhash}{d96564254a1a56b37f2560514ccee836}
\strng{authorfullhashraw}{d96564254a1a56b37f2560514ccee836}
\field{sortinit}{9}
\field{sortinithash}{0a5ebc79d83c96b6579069544c73c7d4}
\field{labelnamesource}{author}
\field{labeltitlesource}{title}
\field{abstract}{Accurate cell-type annotation from spatially resolved single cells is crucial to understand functional spatial biology that is the basis of tissue organization. However, current computational methods for annotating spatially resolved single-cell data are typically based on techniques established for dissociated single-cell technologies and thus do not take spatial organization into account. Here we present {STELLAR}, a geometric deep learning method for cell-type discovery and identification in spatially resolved single-cell datasets. {STELLAR} automatically assigns cells to cell types present in the annotated reference dataset and discovers novel cell types and cell states. {STELLAR} transfers annotations across different dissection regions, different tissues and different donors, and learns cell representations that capture higher-order tissue structures. We successfully applied {STELLAR} to {CODEX} multiplexed fluorescent microscopy data and multiplexed {RNA} imaging datasets. Within the Human {BioMolecular} Atlas Program, {STELLAR} has annotated 2.6 million spatially resolved single cells with dramatic time savings.}
\field{issn}{1548-7105}
\field{journaltitle}{Nature Methods}
\field{langid}{english}
\field{month}{11}
\field{note}{Publisher: Nature Publishing Group}
\field{number}{11}
\field{shortjournal}{Nat Methods}
\field{title}{Annotation of spatially resolved single-cell data with {STELLAR}}
\field{urlday}{7}
\field{urlmonth}{11}
\field{urlyear}{2024}
\field{volume}{19}
\field{year}{2022}
\field{dateera}{ce}
\field{urldateera}{ce}
\field{pages}{1411\bibrangedash 1418}
\range{pages}{8}
\verb{doi}
\verb 10.1038/s41592-022-01651-8
\endverb
\verb{urlraw}
\verb https://www.nature.com/articles/s41592-022-01651-8
\endverb
\verb{url}
\verb https://www.nature.com/articles/s41592-022-01651-8
\endverb
\keyw{Proteomics,Transcriptomics,Fluorescence imaging,Machine learning}
\endentry
\entry{saelens_comparison_2019}{article}{}{}
\name{author}{4}{}{%
{{hash=701038e5ed24e24f31f814ea6154bd1a}{%
family={Saelens},
familyi={S\bibinitperiod},
given={Wouter},
giveni={W\bibinitperiod}}}%
{{hash=da3837faab4d0964842172caaf367130}{%
family={Cannoodt},
familyi={C\bibinitperiod},
given={Robrecht},
giveni={R\bibinitperiod}}}%
{{hash=a91d1238e284ff25bc1b324eaac489ea}{%
family={Todorov},
familyi={T\bibinitperiod},
given={Helena},
giveni={H\bibinitperiod}}}%
{{hash=7e415d219905f66becd75b06920a8d3b}{%
family={Saeys},
familyi={S\bibinitperiod},
given={Yvan},
giveni={Y\bibinitperiod}}}%
}
\strng{namehash}{fb2bb0d9bfd6dc6338886ec4402ec954}
\strng{fullhash}{a89b249187115b2be0b7a5ae9c467aee}
\strng{fullhashraw}{a89b249187115b2be0b7a5ae9c467aee}
\strng{bibnamehash}{fb2bb0d9bfd6dc6338886ec4402ec954}
\strng{authorbibnamehash}{fb2bb0d9bfd6dc6338886ec4402ec954}
\strng{authornamehash}{fb2bb0d9bfd6dc6338886ec4402ec954}
\strng{authorfullhash}{a89b249187115b2be0b7a5ae9c467aee}
\strng{authorfullhashraw}{a89b249187115b2be0b7a5ae9c467aee}
\field{sortinit}{9}
\field{sortinithash}{0a5ebc79d83c96b6579069544c73c7d4}
\field{labelnamesource}{author}
\field{labeltitlesource}{title}
\field{abstract}{Trajectory inference approaches analyze genome-wide omics data from thousands of single cells and computationally infer the order of these cells along developmental trajectories. Although more than 70 trajectory inference tools have already been developed, it is challenging to compare their performance because the input they require and output models they produce vary substantially. Here, we benchmark 45 of these methods on 110 real and 229 synthetic datasets for cellular ordering, topology, scalability and usability. Our results highlight the complementarity of existing tools, and that the choice of method should depend mostly on the dataset dimensions and trajectory topology. Based on these results, we develop a set of guidelines to help users select the best method for their dataset. Our freely available data and evaluation pipeline (https://benchmark.dynverse.org) will aid in the development of improved tools designed to analyze increasingly large and complex single-cell datasets.}
\field{issn}{1546-1696}
\field{journaltitle}{Nature Biotechnology}
\field{langid}{english}
\field{month}{5}
\field{note}{Publisher: Nature Publishing Group}
\field{number}{5}
\field{shortjournal}{Nat Biotechnol}
\field{title}{A comparison of single-cell trajectory inference methods}
\field{urlday}{9}
\field{urlmonth}{9}
\field{urlyear}{2024}
\field{volume}{37}
\field{year}{2019}
\field{dateera}{ce}
\field{urldateera}{ce}
\field{pages}{547\bibrangedash 554}
\range{pages}{8}
\verb{doi}
\verb 10.1038/s41587-019-0071-9
\endverb
\verb{urlraw}
\verb https://www.nature.com/articles/s41587-019-0071-9
\endverb
\verb{url}
\verb https://www.nature.com/articles/s41587-019-0071-9
\endverb
\keyw{Computer modelling,Developmental biology,Differentiation,Software,Time series}
\endentry
\entry{wolf_paga_2019}{article}{}{}
\name{author}{9}{}{%
{{hash=d2b89a02e9170d9e5ead84be3a7257af}{%
family={Wolf},
familyi={W\bibinitperiod},
given={F.\bibnamedelimi Alexander},
giveni={F\bibinitperiod\bibinitdelim A\bibinitperiod}}}%
{{hash=b95c564730350e537ece73069a261178}{%
family={Hamey},
familyi={H\bibinitperiod},
given={Fiona\bibnamedelima K.},
giveni={F\bibinitperiod\bibinitdelim K\bibinitperiod}}}%
{{hash=ebb2af489b9669aed7fd1ebd51c94226}{%
family={Plass},
familyi={P\bibinitperiod},
given={Mireya},
giveni={M\bibinitperiod}}}%
{{hash=3d340bf5e799d6f84b0b4f36547f43f2}{%
family={Solana},
familyi={S\bibinitperiod},
given={Jordi},
giveni={J\bibinitperiod}}}%
{{hash=3ce098804573ea8403ce7108f324954f}{%
family={Dahlin},
familyi={D\bibinitperiod},
given={Joakim\bibnamedelima S.},
giveni={J\bibinitperiod\bibinitdelim S\bibinitperiod}}}%
{{hash=01f9d532a965e704febc2234c9695bae}{%
family={Göttgens},
familyi={G\bibinitperiod},
given={Berthold},
giveni={B\bibinitperiod}}}%
{{hash=cdd7e837c470b8e117d6bd42d0f276bd}{%
family={Rajewsky},
familyi={R\bibinitperiod},
given={Nikolaus},
giveni={N\bibinitperiod}}}%
{{hash=08fac4be060e551849ff2a085d752378}{%
family={Simon},
familyi={S\bibinitperiod},
given={Lukas},
giveni={L\bibinitperiod}}}%
{{hash=e922f50549caa096ad5b259faec33127}{%
family={Theis},
familyi={T\bibinitperiod},
given={Fabian\bibnamedelima J.},
giveni={F\bibinitperiod\bibinitdelim J\bibinitperiod}}}%
}
\strng{namehash}{9bd2e2ec04058d1e8a47f5bc80e1714a}
\strng{fullhash}{13d935f67b478885865f60796cafebf8}
\strng{fullhashraw}{13d935f67b478885865f60796cafebf8}
\strng{bibnamehash}{9bd2e2ec04058d1e8a47f5bc80e1714a}
\strng{authorbibnamehash}{9bd2e2ec04058d1e8a47f5bc80e1714a}
\strng{authornamehash}{9bd2e2ec04058d1e8a47f5bc80e1714a}
\strng{authorfullhash}{13d935f67b478885865f60796cafebf8}
\strng{authorfullhashraw}{13d935f67b478885865f60796cafebf8}
\field{sortinit}{9}
\field{sortinithash}{0a5ebc79d83c96b6579069544c73c7d4}
\field{labelnamesource}{author}
\field{labeltitlesource}{shorttitle}
\field{abstract}{Single-cell {RNA}-seq quantifies biological heterogeneity across both discrete cell types and continuous cell transitions. Partition-based graph abstraction ({PAGA}) provides an interpretable graph-like map of the arising data manifold, based on estimating connectivity of manifold partitions (https://github.com/theislab/paga). {PAGA} maps preserve the global topology of data, allow analyzing data at different resolutions, and result in much higher computational efficiency of the typical exploratory data analysis workflow. We demonstrate the method by inferring structure-rich cell maps with consistent topology across four hematopoietic datasets, adult planaria and the zebrafish embryo and benchmark computational performance on one million neurons.}
\field{day}{19}
\field{issn}{1474-760X}
\field{journaltitle}{Genome Biology}
\field{month}{3}
\field{number}{1}
\field{shortjournal}{Genome Biology}
\field{shorttitle}{{PAGA}}
\field{title}{{PAGA}: graph abstraction reconciles clustering with trajectory inference through a topology preserving map of single cells}
\field{urlday}{10}
\field{urlmonth}{11}
\field{urlyear}{2024}
\field{volume}{20}
\field{year}{2019}
\field{dateera}{ce}
\field{urldateera}{ce}
\field{pages}{59}
\range{pages}{1}
\verb{doi}
\verb 10.1186/s13059-019-1663-x
\endverb
\verb{urlraw}
\verb https://doi.org/10.1186/s13059-019-1663-x
\endverb
\verb{url}
\verb https://doi.org/10.1186/s13059-019-1663-x
\endverb
\endentry
\entry{haviv_covariance_2024}{article}{}{}
\name{author}{13}{}{%
{{hash=7fae7ab410f444e9974fbb55982c13f6}{%
family={Haviv},
familyi={H\bibinitperiod},
given={Doron},
giveni={D\bibinitperiod}}}%
{{hash=9aa217f5e4dcf9f8dc57136ff6e7c7cf}{%
family={Remšík},
familyi={R\bibinitperiod},
given={Ján},
giveni={J\bibinitperiod}}}%
{{hash=33a4708ba1add5fc3db8abfb3f6d70d7}{%
family={Gatie},
familyi={G\bibinitperiod},
given={Mohamed},
giveni={M\bibinitperiod}}}%
{{hash=cf7de96c183b5f2152c62fb702b09da5}{%
family={Snopkowski},
familyi={S\bibinitperiod},
given={Catherine},
giveni={C\bibinitperiod}}}%
{{hash=6dc88f3699ecb574575bd624b53130dd}{%
family={Takizawa},
familyi={T\bibinitperiod},
given={Meril},
giveni={M\bibinitperiod}}}%
{{hash=af3078cc25534b17e3761b966a3d94f6}{%
family={Pereira},
familyi={P\bibinitperiod},
given={Nathan},
giveni={N\bibinitperiod}}}%
{{hash=af9c1c818d36f2d98e2719b9ff6152a5}{%
family={Bashkin},
familyi={B\bibinitperiod},
given={John},
giveni={J\bibinitperiod}}}%
{{hash=77e9a5a2164c8b4228ff763d5c70f30c}{%
family={Jovanovich},
familyi={J\bibinitperiod},
given={Stevan},
giveni={S\bibinitperiod}}}%
{{hash=7fb90268aaea27ed1c94a5a49dcfa67a}{%
family={Nawy},
familyi={N\bibinitperiod},
given={Tal},
giveni={T\bibinitperiod}}}%
{{hash=d5977472fbc9e01a01427ada83122458}{%
family={Chaligne},
familyi={C\bibinitperiod},
given={Ronan},
giveni={R\bibinitperiod}}}%
{{hash=dc9d0ca5d7135b0579b869591697142b}{%
family={Boire},
familyi={B\bibinitperiod},
given={Adrienne},
giveni={A\bibinitperiod}}}%
{{hash=f417da223642ca00654d23fc88186c18}{%
family={Hadjantonakis},
familyi={H\bibinitperiod},
given={Anna-Katerina},
giveni={A\bibinithyphendelim K\bibinitperiod}}}%
{{hash=d39cb9de28d4bf500fb5ea03f1687db8}{%
family={Pe’er},
familyi={P\bibinitperiod},
given={Dana},
giveni={D\bibinitperiod}}}%
}
\strng{namehash}{4346bab9f885390ee0148ddb431b3133}
\strng{fullhash}{1b1d56a180da92474f5811407f68d73c}
\strng{fullhashraw}{1b1d56a180da92474f5811407f68d73c}
\strng{bibnamehash}{4346bab9f885390ee0148ddb431b3133}
\strng{authorbibnamehash}{4346bab9f885390ee0148ddb431b3133}
\strng{authornamehash}{4346bab9f885390ee0148ddb431b3133}
\strng{authorfullhash}{1b1d56a180da92474f5811407f68d73c}
\strng{authorfullhashraw}{1b1d56a180da92474f5811407f68d73c}
\field{sortinit}{9}
\field{sortinithash}{0a5ebc79d83c96b6579069544c73c7d4}
\field{labelnamesource}{author}
\field{labeltitlesource}{title}
\field{abstract}{A key challenge of analyzing data from high-resolution spatial profiling technologies is to suitably represent the features of cellular neighborhoods or niches. Here we introduce the covariance environment ({COVET}), a representation that leverages the gene–gene covariate structure across cells in the niche to capture the multivariate nature of cellular interactions within it. We define a principled optimal transport-based distance metric between {COVET} niches that scales to millions of cells. Using {COVET} to encode spatial context, we developed environmental variational inference ({ENVI}), a conditional variational autoencoder that jointly embeds spatial and single-cell {RNA} sequencing data into a latent space. {ENVI} includes two decoders: one to impute gene expression across the spatial modality and a second to project spatial information onto single-cell data. {ENVI} can confer spatial context to genomics data from single dissociated cells and outperforms alternatives for imputing gene expression on diverse spatial datasets.}
\field{day}{2}
\field{issn}{1546-1696}
\field{journaltitle}{Nature Biotechnology}
\field{langid}{english}
\field{month}{4}
\field{note}{Publisher: Nature Publishing Group}
\field{shortjournal}{Nat Biotechnol}
\field{title}{The covariance environment defines cellular niches for spatial inference}
\field{urlday}{1}
\field{urlmonth}{11}
\field{urlyear}{2024}
\field{year}{2024}
\field{dateera}{ce}
\field{urldateera}{ce}
\field{pages}{1\bibrangedash 12}
\range{pages}{12}
\verb{doi}
\verb 10.1038/s41587-024-02193-4
\endverb
\verb{urlraw}
\verb https://www.nature.com/articles/s41587-024-02193-4
\endverb
\verb{url}
\verb https://www.nature.com/articles/s41587-024-02193-4
\endverb
\keyw{Computational models}
\endentry
\entry{crabbe_label-free_2022}{inproceedings}{}{}
\name{author}{2}{}{%
{{hash=157950a321ecba7473a202bcf214a929}{%
family={Crabbé},
familyi={C\bibinitperiod},
given={Jonathan},
giveni={J\bibinitperiod}}}%
{{hash=44c5ebc1d90d166c1418c35650bdd2ef}{%
family={Schaar},
familyi={S\bibinitperiod},
given={Mihaela\bibnamedelimb van\bibnamedelima der},
giveni={M\bibinitperiod\bibinitdelim v\bibinitperiod\bibinitdelim d\bibinitperiod}}}%
}
\list{publisher}{1}{%
{PMLR}%
}
\strng{namehash}{5841d4c9db7e235b6a4ddba6583ad8c8}
\strng{fullhash}{5841d4c9db7e235b6a4ddba6583ad8c8}
\strng{fullhashraw}{5841d4c9db7e235b6a4ddba6583ad8c8}
\strng{bibnamehash}{5841d4c9db7e235b6a4ddba6583ad8c8}
\strng{authorbibnamehash}{5841d4c9db7e235b6a4ddba6583ad8c8}
\strng{authornamehash}{5841d4c9db7e235b6a4ddba6583ad8c8}
\strng{authorfullhash}{5841d4c9db7e235b6a4ddba6583ad8c8}
\strng{authorfullhashraw}{5841d4c9db7e235b6a4ddba6583ad8c8}
\field{sortinit}{1}
\field{sortinithash}{4f6aaa89bab872aa0999fec09ff8e98a}
\field{labelnamesource}{author}
\field{labeltitlesource}{title}
\field{abstract}{Unsupervised black-box models are challenging to interpret. Indeed, most existing explainability methods require labels to select which component(s) of the black-box’s output to interpret. In the absence of labels, black-box outputs often are representation vectors whose components do not correspond to any meaningful quantity. Hence, choosing which component(s) to interpret in a label-free unsupervised/self-supervised setting is an important, yet unsolved problem. To bridge this gap in the literature, we introduce two crucial extensions of post-hoc explanation techniques: (1) label-free feature importance and (2) label-free example importance that respectively highlight influential features and training examples for a black-box to construct representations at inference time. We demonstrate that our extensions can be successfully implemented as simple wrappers around many existing feature and example importance methods. We illustrate the utility of our label-free explainability paradigm through a qualitative and quantitative comparison of representation spaces learned by various autoencoders trained on distinct unsupervised tasks.}
\field{booktitle}{Proceedings of the 39th International Conference on Machine Learning}
\field{day}{28}
\field{eventtitle}{International Conference on Machine Learning}
\field{langid}{english}
\field{month}{6}
\field{note}{{ISSN}: 2640-3498}
\field{title}{Label-Free Explainability for Unsupervised Models}
\field{urlday}{20}
\field{urlmonth}{10}
\field{urlyear}{2024}
\field{year}{2022}
\field{dateera}{ce}
\field{urldateera}{ce}
\field{pages}{4391\bibrangedash 4420}
\range{pages}{30}
\verb{file}
\verb Full Text PDF:/Users/istresec/Zotero/storage/9ML6SV6X/Crabbé and Schaar - 2022 - Label-Free Explainability for Unsupervised Models.pdf:application/pdf
\endverb
\verb{urlraw}
\verb https://proceedings.mlr.press/v162/crabbe22a.html
\endverb
\verb{url}
\verb https://proceedings.mlr.press/v162/crabbe22a.html
\endverb
\endentry
\entry{locatello_sober_2020}{misc}{}{}
\name{author}{7}{}{%
{{hash=c1fe97b077a5720d9fd9483464391fe6}{%
family={Locatello},
familyi={L\bibinitperiod},
given={Francesco},
giveni={F\bibinitperiod}}}%
{{hash=6e0afe0dd7f80126ec663a279b8d6212}{%
family={Bauer},
familyi={B\bibinitperiod},
given={Stefan},
giveni={S\bibinitperiod}}}%
{{hash=26b9b9f1c61e9425fb38070e6d2c9f31}{%
family={Lucic},
familyi={L\bibinitperiod},
given={Mario},
giveni={M\bibinitperiod}}}%
{{hash=ca596a0a9d87ca9f7999db4d71c7e577}{%
family={Rätsch},
familyi={R\bibinitperiod},
given={Gunnar},
giveni={G\bibinitperiod}}}%
{{hash=450963f966620925cb8fecd32f7a6ee1}{%
family={Gelly},
familyi={G\bibinitperiod},
given={Sylvain},
giveni={S\bibinitperiod}}}%
{{hash=ca31cc11ec9370460148c3a9c48fce45}{%
family={Schölkopf},
familyi={S\bibinitperiod},
given={Bernhard},
giveni={B\bibinitperiod}}}%
{{hash=b8d6ee5b98a48b04ccf119b64508d63c}{%
family={Bachem},
familyi={B\bibinitperiod},
given={Olivier},
giveni={O\bibinitperiod}}}%
}
\list{publisher}{1}{%
{arXiv}%
}
\strng{namehash}{fc2e694b6180d3f785483c03ed488308}
\strng{fullhash}{2ed37e64f36b7fa556a1e4144e43546c}
\strng{fullhashraw}{2ed37e64f36b7fa556a1e4144e43546c}
\strng{bibnamehash}{fc2e694b6180d3f785483c03ed488308}
\strng{authorbibnamehash}{fc2e694b6180d3f785483c03ed488308}
\strng{authornamehash}{fc2e694b6180d3f785483c03ed488308}
\strng{authorfullhash}{2ed37e64f36b7fa556a1e4144e43546c}
\strng{authorfullhashraw}{2ed37e64f36b7fa556a1e4144e43546c}
\field{sortinit}{1}
\field{sortinithash}{4f6aaa89bab872aa0999fec09ff8e98a}
\field{labelnamesource}{author}
\field{labeltitlesource}{title}
\field{abstract}{The idea behind the {\textbackslash}emph\{unsupervised\} learning of {\textbackslash}emph\{disentangled\} representations is that real-world data is generated by a few explanatory factors of variation which can be recovered by unsupervised learning algorithms. In this paper, we provide a sober look at recent progress in the field and challenge some common assumptions. We first theoretically show that the unsupervised learning of disentangled representations is fundamentally impossible without inductive biases on both the models and the data. Then, we train over \$14000\$ models covering most prominent methods and evaluation metrics in a reproducible large-scale experimental study on eight data sets. We observe that while the different methods successfully enforce properties "encouraged" by the corresponding losses, well-disentangled models seemingly cannot be identified without supervision. Furthermore, different evaluation metrics do not always agree on what should be considered "disentangled" and exhibit systematic differences in the estimation. Finally, increased disentanglement does not seem to necessarily lead to a decreased sample complexity of learning for downstream tasks. Our results suggest that future work on disentanglement learning should be explicit about the role of inductive biases and (implicit) supervision, investigate concrete benefits of enforcing disentanglement of the learned representations, and consider a reproducible experimental setup covering several data sets.}
\field{day}{27}
\field{eprinttype}{arxiv}
\field{month}{10}
\field{number}{{arXiv}:2010.14766}
\field{title}{A Sober Look at the Unsupervised Learning of Disentangled Representations and their Evaluation}
\field{urlday}{31}
\field{urlmonth}{10}
\field{urlyear}{2024}
\field{year}{2020}
\field{dateera}{ce}
\field{urldateera}{ce}
\verb{doi}
\verb 10.48550/arXiv.2010.14766
\endverb
\verb{eprint}
\verb 2010.14766
\endverb
\verb{urlraw}
\verb http://arxiv.org/abs/2010.14766
\endverb
\verb{url}
\verb http://arxiv.org/abs/2010.14766
\endverb
\keyw{Computer Science - Machine Learning,Statistics - Machine Learning}
\endentry
\entry{murphy_probabilistic_2022}{book}{}{}
\name{author}{1}{}{%
{{hash=99413be56c82adf72b6474dcdf8d3023}{%
family={Murphy},
familyi={M\bibinitperiod},
given={Kevin\bibnamedelima P.},
giveni={K\bibinitperiod\bibinitdelim P\bibinitperiod}}}%
}
\list{publisher}{1}{%
{MIT Press}%
}
\strng{namehash}{99413be56c82adf72b6474dcdf8d3023}
\strng{fullhash}{99413be56c82adf72b6474dcdf8d3023}
\strng{fullhashraw}{99413be56c82adf72b6474dcdf8d3023}
\strng{bibnamehash}{99413be56c82adf72b6474dcdf8d3023}
\strng{authorbibnamehash}{99413be56c82adf72b6474dcdf8d3023}
\strng{authornamehash}{99413be56c82adf72b6474dcdf8d3023}
\strng{authorfullhash}{99413be56c82adf72b6474dcdf8d3023}
\strng{authorfullhashraw}{99413be56c82adf72b6474dcdf8d3023}
\field{sortinit}{1}
\field{sortinithash}{4f6aaa89bab872aa0999fec09ff8e98a}
\field{labelnamesource}{author}
\field{labeltitlesource}{title}
\field{title}{Probabilistic Machine Learning: An introduction}
\field{year}{2022}
\verb{urlraw}
\verb http://probml.github.io/book1
\endverb
\verb{url}
\verb http://probml.github.io/book1
\endverb
\endentry
\entry{meila_manifold_2024}{article}{}{}
\name{author}{2}{}{%
{{hash=8782cf1fc28b7fc8f203fc1fc7c4b674}{%
family={Meilă},
familyi={M\bibinitperiod},
given={Marina},
giveni={M\bibinitperiod}}}%
{{hash=663582688bd93da59981a69a5ef6c73d}{%
family={Zhang},
familyi={Z\bibinitperiod},
given={Hanyu},
giveni={H\bibinitperiod}}}%
}
\strng{namehash}{118aea1b9a85d802adad5b9145a3a109}
\strng{fullhash}{118aea1b9a85d802adad5b9145a3a109}
\strng{fullhashraw}{118aea1b9a85d802adad5b9145a3a109}
\strng{bibnamehash}{118aea1b9a85d802adad5b9145a3a109}
\strng{authorbibnamehash}{118aea1b9a85d802adad5b9145a3a109}
\strng{authornamehash}{118aea1b9a85d802adad5b9145a3a109}
\strng{authorfullhash}{118aea1b9a85d802adad5b9145a3a109}
\strng{authorfullhashraw}{118aea1b9a85d802adad5b9145a3a109}
\field{sortinit}{1}
\field{sortinithash}{4f6aaa89bab872aa0999fec09ff8e98a}
\field{labelnamesource}{author}
\field{labeltitlesource}{shorttitle}
\field{abstract}{Manifold learning ({ML}), also known as nonlinear dimension reduction, is a set of methods to find the low-dimensional structure of data. Dimension reduction for large, high-dimensional data is not merely a way to reduce the data; the new representations and descriptors obtained by {ML} reveal the geometric shape of high-dimensional point clouds and allow one to visualize, denoise, and interpret them. This review presents the underlying principles of {ML}, its representative methods, and their statistical foundations, all from a practicing statistician\'s perspective. It describes the trade-offs and what theory tells us about the parameter and algorithmic choices we make in order to obtain reliable conclusions.}
\field{day}{22}
\field{issn}{2326-8298, 2326-831X}
\field{issue}{Volume 11, 2024}
\field{journaltitle}{Annual Review of Statistics and Its Application}
\field{langid}{english}
\field{month}{4}
\field{note}{Publisher: Annual Reviews}
\field{shorttitle}{Manifold Learning}
\field{title}{Manifold Learning: What, How, and Why}
\field{urlday}{28}
\field{urlmonth}{10}
\field{urlyear}{2024}
\field{volume}{11}
\field{year}{2024}
\field{dateera}{ce}
\field{urldateera}{ce}
\field{pages}{393\bibrangedash 417}
\range{pages}{25}
\verb{doi}
\verb 10.1146/annurev-statistics-040522-115238
\endverb
\verb{urlraw}
\verb https://www.annualreviews.org/content/journals/10.1146/annurev-statistics-040522-115238
\endverb
\verb{url}
\verb https://www.annualreviews.org/content/journals/10.1146/annurev-statistics-040522-115238
\endverb
\endentry
\entry{maaten_visualizing_2008}{article}{}{}
\name{author}{2}{}{%
{{hash=47fbe2837893a84fb516e9e85ba7aa36}{%
family={Maaten},
familyi={M\bibinitperiod},
given={Laurens\bibnamedelimb van\bibnamedelima der},
giveni={L\bibinitperiod\bibinitdelim v\bibinitperiod\bibinitdelim d\bibinitperiod}}}%
{{hash=9a8750ccdb2a4cf14d2655face1ce016}{%
family={Hinton},
familyi={H\bibinitperiod},
given={Geoffrey},
giveni={G\bibinitperiod}}}%
}
\strng{namehash}{07df37c1f29fdfb7765c821206be824a}
\strng{fullhash}{07df37c1f29fdfb7765c821206be824a}
\strng{fullhashraw}{07df37c1f29fdfb7765c821206be824a}
\strng{bibnamehash}{07df37c1f29fdfb7765c821206be824a}
\strng{authorbibnamehash}{07df37c1f29fdfb7765c821206be824a}
\strng{authornamehash}{07df37c1f29fdfb7765c821206be824a}
\strng{authorfullhash}{07df37c1f29fdfb7765c821206be824a}
\strng{authorfullhashraw}{07df37c1f29fdfb7765c821206be824a}
\field{sortinit}{1}
\field{sortinithash}{4f6aaa89bab872aa0999fec09ff8e98a}
\field{labelnamesource}{author}
\field{labeltitlesource}{title}
\field{abstract}{We present a new technique called "t-{SNE}" that visualizes high-dimensional data by giving each datapoint a location in a two or three-dimensional map. The technique is a variation of Stochastic Neighbor Embedding (Hinton and Roweis, 2002) that is much easier to optimize, and produces significantly better visualizations by reducing the tendency to crowd points together in the center of the map. t-{SNE} is better than existing techniques at creating a single map that reveals structure at many different scales. This is particularly important for high-dimensional data that lie on several different, but related, low-dimensional manifolds, such as images ofobjects from multiple classes seen from multiple viewpoints. For visualizing the structure of very large data sets, we show how t-{SNE} can use random walks on neighborhood graphs to allow the implicit structure of all of the data to influence the way in which a subset of the data is displayed. We illustrate the performance of t-{SNE} on a wide variety of data sets and compare it with many other non-parametric visualization techniques, including Sammon mapping, Isomap, and Locally Linear Embedding. The visualizations produced by t-{SNE} are significantly better than those produced by the other techniques on almost all of the data sets.}
\field{issn}{1533-7928}
\field{journaltitle}{Journal of Machine Learning Research}
\field{number}{86}
\field{title}{Visualizing Data using t-{SNE}}
\field{urlday}{5}
\field{urlmonth}{11}
\field{urlyear}{2024}
\field{volume}{9}
\field{year}{2008}
\field{dateera}{ce}
\field{urldateera}{ce}
\field{pages}{2579\bibrangedash 2605}
\range{pages}{27}
\verb{urlraw}
\verb http://jmlr.org/papers/v9/vandermaaten08a.html
\endverb
\verb{url}
\verb http://jmlr.org/papers/v9/vandermaaten08a.html
\endverb
\endentry
\entry{mcinnes_umap_2020}{misc}{}{}
\name{author}{3}{}{%
{{hash=f3edd0ee6ca72eca5c532b9c1fcee621}{%
family={{McInnes}},
familyi={M\bibinitperiod},
given={Leland},
giveni={L\bibinitperiod}}}%
{{hash=2a653f5c3174b96798d6336399101032}{%
family={Healy},
familyi={H\bibinitperiod},
given={John},
giveni={J\bibinitperiod}}}%
{{hash=542b470ec223367aba58d9d095e4e340}{%
family={Melville},
familyi={M\bibinitperiod},
given={James},
giveni={J\bibinitperiod}}}%
}
\list{publisher}{1}{%
{arXiv}%
}
\strng{namehash}{9bc0813b09f8460b9f60233db84de773}
\strng{fullhash}{9bc0813b09f8460b9f60233db84de773}
\strng{fullhashraw}{9bc0813b09f8460b9f60233db84de773}
\strng{bibnamehash}{9bc0813b09f8460b9f60233db84de773}
\strng{authorbibnamehash}{9bc0813b09f8460b9f60233db84de773}
\strng{authornamehash}{9bc0813b09f8460b9f60233db84de773}
\strng{authorfullhash}{9bc0813b09f8460b9f60233db84de773}
\strng{authorfullhashraw}{9bc0813b09f8460b9f60233db84de773}
\field{sortinit}{1}
\field{sortinithash}{4f6aaa89bab872aa0999fec09ff8e98a}
\field{labelnamesource}{author}
\field{labeltitlesource}{shorttitle}
\field{abstract}{{UMAP} (Uniform Manifold Approximation and Projection) is a novel manifold learning technique for dimension reduction. {UMAP} is constructed from a theoretical framework based in Riemannian geometry and algebraic topology. The result is a practical scalable algorithm that applies to real world data. The {UMAP} algorithm is competitive with t-{SNE} for visualization quality, and arguably preserves more of the global structure with superior run time performance. Furthermore, {UMAP} has no computational restrictions on embedding dimension, making it viable as a general purpose dimension reduction technique for machine learning.}
\field{day}{18}
\field{eprinttype}{arxiv}
\field{month}{9}
\field{number}{{arXiv}:1802.03426}
\field{shorttitle}{{UMAP}}
\field{title}{{UMAP}: Uniform Manifold Approximation and Projection for Dimension Reduction}
\field{urlday}{5}
\field{urlmonth}{11}
\field{urlyear}{2024}
\field{year}{2020}
\field{dateera}{ce}
\field{urldateera}{ce}
\verb{doi}
\verb 10.48550/arXiv.1802.03426
\endverb
\verb{eprint}
\verb 1802.03426
\endverb
\verb{urlraw}
\verb http://arxiv.org/abs/1802.03426
\endverb
\verb{url}
\verb http://arxiv.org/abs/1802.03426
\endverb
\keyw{Computer Science - Computational Geometry,Computer Science - Machine Learning,Statistics - Machine Learning}
\endentry
\entry{han_enhance_2022}{article}{}{}
\name{author}{5}{}{%
{{hash=a8f60c0d4beb570e550a786f530a4826}{%
family={Han},
familyi={H\bibinitperiod},
given={Henry},
giveni={H\bibinitperiod}}}%
{{hash=3cc5c677fd716a033ad835e5d5558c3b}{%
family={Li},
familyi={L\bibinitperiod},
given={Wentian},
giveni={W\bibinitperiod}}}%
{{hash=607e58e5ef457d20627b0b87648c5cf3}{%
family={Wang},
familyi={W\bibinitperiod},
given={Jiacun},
giveni={J\bibinitperiod}}}%
{{hash=8962a3d10b03a059d645d4ad04b6a6f6}{%
family={Qin},
familyi={Q\bibinitperiod},
given={Guimin},
giveni={G\bibinitperiod}}}%
{{hash=f85da19d49b42acadd4e41ca635bedd2}{%
family={Qin},
familyi={Q\bibinitperiod},
given={Xianya},
giveni={X\bibinitperiod}}}%
}
\strng{namehash}{76f6cfb232233251367b889d3831aabb}
\strng{fullhash}{e19e4ad3a33cfb4a7a51e46b715970c6}
\strng{fullhashraw}{e19e4ad3a33cfb4a7a51e46b715970c6}
\strng{bibnamehash}{76f6cfb232233251367b889d3831aabb}
\strng{authorbibnamehash}{76f6cfb232233251367b889d3831aabb}
\strng{authornamehash}{76f6cfb232233251367b889d3831aabb}
\strng{authorfullhash}{e19e4ad3a33cfb4a7a51e46b715970c6}
\strng{authorfullhashraw}{e19e4ad3a33cfb4a7a51e46b715970c6}
\field{sortinit}{1}
\field{sortinithash}{4f6aaa89bab872aa0999fec09ff8e98a}
\field{labelnamesource}{author}
\field{labeltitlesource}{title}
\field{abstract}{The explainability of manifold learning is rarely investigated though there is an urgent need from both {AI} theory and practice. In this study, we propose a novel degree of locality preservation ({DLP}) approach to study the interpretability of manifold learning. We estimate the {DLPs} of the state-of-the-art manifold learning methods: t-{SNE} and {UMAP} as well as related methods: {LLE}, {HLLE}, and {LTSA} along with widely used {PCA} across benchmark datasets classified as low-dimensional and high-dimensional data. Our study provides well-founded explanations of the manifold learning methods in terms of the {DLPs}. The order of their {DLPs} follows t-{SNE}{>} {UMAP}{>} {LLE}{>} {HLLE}/{PCA}/{LTSA}, though it may have some exceptions for some high-dimensional data. Both t-{SNE} and {UMAP} demonstrate an embedding distance amplification mechanism under the Euclidean distance that forces the latent local data geometry to stand out in dimension reduction. It not only explains why t-{SNE} and {UMAP} have higher {DLPs} than other peers, but also indicates they are not locally isometric under the Euclidean distance. Furthermore, it discovers that t-{SNE} and {UMAP} embeddings demonstrate similar nonlinear nature in dimension reduction, besides larger (smaller) data variances for low (high)-dimensional data. To the best of our knowledge, this study is the first work about the explainability of manifold learning. The proposed methods and corresponding results can be also extended to other dimension reduction techniques.}
\field{day}{21}
\field{issn}{0925-2312}
\field{journaltitle}{Neurocomputing}
\field{month}{8}
\field{shortjournal}{Neurocomputing}
\field{title}{Enhance explainability of manifold learning}
\field{urlday}{20}
\field{urlmonth}{10}
\field{urlyear}{2024}
\field{volume}{500}
\field{year}{2022}
\field{dateera}{ce}
\field{urldateera}{ce}
\field{pages}{877\bibrangedash 895}
\range{pages}{19}
\verb{doi}
\verb 10.1016/j.neucom.2022.05.119
\endverb
\verb{file}
\verb ScienceDirect Snapshot:/Users/istresec/Zotero/storage/8GKE9WQ5/S0925231222007044.html:text/html
\endverb
\verb{urlraw}
\verb https://www.sciencedirect.com/science/article/pii/S0925231222007044
\endverb
\verb{url}
\verb https://www.sciencedirect.com/science/article/pii/S0925231222007044
\endverb
\keyw{Dimension reduction,Explainable {AI},Locally isometric,Manifold learning,t-{SNE},{UMAP}}
\endentry
\entry{becht_dimensionality_2019}{article}{}{}
\name{author}{8}{}{%
{{hash=3c5080fc99756015f0786746cac3eeba}{%
family={Becht},
familyi={B\bibinitperiod},
given={Etienne},
giveni={E\bibinitperiod}}}%
{{hash=f3edd0ee6ca72eca5c532b9c1fcee621}{%
family={{McInnes}},
familyi={M\bibinitperiod},
given={Leland},
giveni={L\bibinitperiod}}}%
{{hash=2a653f5c3174b96798d6336399101032}{%
family={Healy},
familyi={H\bibinitperiod},
given={John},
giveni={J\bibinitperiod}}}%
{{hash=6a96aecae398a115f9ab73919adaaa48}{%
family={Dutertre},
familyi={D\bibinitperiod},
given={Charles-Antoine},
giveni={C\bibinithyphendelim A\bibinitperiod}}}%
{{hash=a75715644c83cc7aa7d2c0a0e3d6ebad}{%
family={Kwok},
familyi={K\bibinitperiod},
given={Immanuel\bibnamedelimb W.\bibnamedelimi H.},
giveni={I\bibinitperiod\bibinitdelim W\bibinitperiod\bibinitdelim H\bibinitperiod}}}%
{{hash=e6bb6eb3f744349dc68ed8c28f1074ac}{%
family={Ng},
familyi={N\bibinitperiod},
given={Lai\bibnamedelima Guan},
giveni={L\bibinitperiod\bibinitdelim G\bibinitperiod}}}%
{{hash=61cda448811b79a3524d026dc88acc56}{%
family={Ginhoux},
familyi={G\bibinitperiod},
given={Florent},
giveni={F\bibinitperiod}}}%
{{hash=8f6b1c03b03e094fa36aaa48fe088503}{%
family={Newell},
familyi={N\bibinitperiod},
given={Evan\bibnamedelima W.},
giveni={E\bibinitperiod\bibinitdelim W\bibinitperiod}}}%
}
\strng{namehash}{5bb0f5f5ba56314dab1630dca7862847}
\strng{fullhash}{9d4e6e9113411a37a672789ee94c4f04}
\strng{fullhashraw}{9d4e6e9113411a37a672789ee94c4f04}
\strng{bibnamehash}{5bb0f5f5ba56314dab1630dca7862847}
\strng{authorbibnamehash}{5bb0f5f5ba56314dab1630dca7862847}
\strng{authornamehash}{5bb0f5f5ba56314dab1630dca7862847}
\strng{authorfullhash}{9d4e6e9113411a37a672789ee94c4f04}
\strng{authorfullhashraw}{9d4e6e9113411a37a672789ee94c4f04}
\field{sortinit}{1}
\field{sortinithash}{4f6aaa89bab872aa0999fec09ff8e98a}
\field{labelnamesource}{author}
\field{labeltitlesource}{title}
\field{abstract}{A benchmarking analysis on single-cell {RNA}-seq and mass cytometry data reveals the best-performing technique for dimensionality reduction.}
\field{issn}{1546-1696}
\field{journaltitle}{Nature Biotechnology}
\field{langid}{english}
\field{month}{1}
\field{note}{Publisher: Nature Publishing Group}
\field{number}{1}
\field{shortjournal}{Nat Biotechnol}
\field{title}{Dimensionality reduction for visualizing single-cell data using {UMAP}}
\field{urlday}{10}
\field{urlmonth}{11}
\field{urlyear}{2024}
\field{volume}{37}
\field{year}{2019}
\field{dateera}{ce}
\field{urldateera}{ce}
\field{pages}{38\bibrangedash 44}
\range{pages}{7}
\verb{doi}
\verb 10.1038/nbt.4314
\endverb
\verb{urlraw}
\verb https://www.nature.com/articles/nbt.4314
\endverb
\verb{url}
\verb https://www.nature.com/articles/nbt.4314
\endverb
\keyw{Computational biology and bioinformatics,Data mining,Immunology}
\endentry
\entry{wang_understanding_2021}{misc}{}{}
\name{author}{4}{}{%
{{hash=c9f04ed1e2ebd2b6051f11fe032debb8}{%
family={Wang},
familyi={W\bibinitperiod},
given={Yingfan},
giveni={Y\bibinitperiod}}}%
{{hash=a9a5cc3d6840b192e097f4a1983a49e3}{%
family={Huang},
familyi={H\bibinitperiod},
given={Haiyang},
giveni={H\bibinitperiod}}}%
{{hash=ed6b4fef67abb4c043b72d1843b36826}{%
family={Rudin},
familyi={R\bibinitperiod},
given={Cynthia},
giveni={C\bibinitperiod}}}%
{{hash=52d4de1564b2ebbb7bdbb1358fdde560}{%
family={Shaposhnik},
familyi={S\bibinitperiod},
given={Yaron},
giveni={Y\bibinitperiod}}}%
}
\list{publisher}{1}{%
{arXiv}%
}
\strng{namehash}{3d07142162c99eeed3ec2935eba873b0}
\strng{fullhash}{e7c135365aa8d1e44669af510493374b}
\strng{fullhashraw}{e7c135365aa8d1e44669af510493374b}
\strng{bibnamehash}{3d07142162c99eeed3ec2935eba873b0}
\strng{authorbibnamehash}{3d07142162c99eeed3ec2935eba873b0}
\strng{authornamehash}{3d07142162c99eeed3ec2935eba873b0}
\strng{authorfullhash}{e7c135365aa8d1e44669af510493374b}
\strng{authorfullhashraw}{e7c135365aa8d1e44669af510493374b}
\field{extraname}{2}
\field{sortinit}{1}
\field{sortinithash}{4f6aaa89bab872aa0999fec09ff8e98a}
\field{labelnamesource}{author}
\field{labeltitlesource}{shorttitle}
\field{abstract}{Dimension reduction ({DR}) techniques such as t-{SNE}, {UMAP}, and {TriMAP} have demonstrated impressive visualization performance on many real world datasets. One tension that has always faced these methods is the trade-off between preservation of global structure and preservation of local structure: these methods can either handle one or the other, but not both. In this work, our main goal is to understand what aspects of {DR} methods are important for preserving both local and global structure: it is difficult to design a better method without a true understanding of the choices we make in our algorithms and their empirical impact on the lower-dimensional embeddings they produce. Towards the goal of local structure preservation, we provide several useful design principles for {DR} loss functions based on our new understanding of the mechanisms behind successful {DR} methods. Towards the goal of global structure preservation, our analysis illuminates that the choice of which components to preserve is important. We leverage these insights to design a new algorithm for {DR}, called Pairwise Controlled Manifold Approximation Projection ({PaCMAP}), which preserves both local and global structure. Our work provides several unexpected insights into what design choices both to make and avoid when constructing {DR} algorithms.}
\field{day}{24}
\field{eprinttype}{arxiv}
\field{month}{8}
\field{number}{{arXiv}:2012.04456}
\field{shorttitle}{Understanding How Dimension Reduction Tools Work}
\field{title}{Understanding How Dimension Reduction Tools Work: An Empirical Approach to Deciphering t-{SNE}, {UMAP}, {TriMAP}, and {PaCMAP} for Data Visualization}
\field{urlday}{9}
\field{urlmonth}{11}
\field{urlyear}{2024}
\field{year}{2021}
\field{dateera}{ce}
\field{urldateera}{ce}
\verb{doi}
\verb 10.48550/arXiv.2012.04456
\endverb
\verb{eprint}
\verb 2012.04456
\endverb
\verb{urlraw}
\verb http://arxiv.org/abs/2012.04456
\endverb
\verb{url}
\verb http://arxiv.org/abs/2012.04456
\endverb
\keyw{Computer Science - Machine Learning,Statistics - Machine Learning}
\endentry
\entry{xia_statistical_2024}{article}{}{}
\name{author}{3}{}{%
{{hash=d3f32f069f829308ecc84c45f0b971a5}{%
family={Xia},
familyi={X\bibinitperiod},
given={Lucy},
giveni={L\bibinitperiod}}}%
{{hash=12ef8415b78d430ead78d68478aa2f8d}{%
family={Lee},
familyi={L\bibinitperiod},
given={Christy},
giveni={C\bibinitperiod}}}%
{{hash=d9f6cf5f2463981f2d0102c78995e9f5}{%
family={Li},
familyi={L\bibinitperiod},
given={Jingyi\bibnamedelima Jessica},
giveni={J\bibinitperiod\bibinitdelim J\bibinitperiod}}}%
}
\strng{namehash}{7897eb1631acb043aedea8a188cd55a7}
\strng{fullhash}{7897eb1631acb043aedea8a188cd55a7}
\strng{fullhashraw}{7897eb1631acb043aedea8a188cd55a7}
\strng{bibnamehash}{7897eb1631acb043aedea8a188cd55a7}
\strng{authorbibnamehash}{7897eb1631acb043aedea8a188cd55a7}
\strng{authornamehash}{7897eb1631acb043aedea8a188cd55a7}
\strng{authorfullhash}{7897eb1631acb043aedea8a188cd55a7}
\strng{authorfullhashraw}{7897eb1631acb043aedea8a188cd55a7}
\field{sortinit}{1}
\field{sortinithash}{4f6aaa89bab872aa0999fec09ff8e98a}
\field{labelnamesource}{author}
\field{labeltitlesource}{title}
\field{abstract}{Two-dimensional (2D) embedding methods are crucial for single-cell data visualization. Popular methods such as t-distributed stochastic neighbor embedding (t-{SNE}) and uniform manifold approximation and projection ({UMAP}) are commonly used for visualizing cell clusters; however, it is well known that t-{SNE} and {UMAP}’s 2D embeddings might not reliably inform the similarities among cell clusters. Motivated by this challenge, we present a statistical method, {scDEED}, for detecting dubious cell embeddings output by a 2D-embedding method. By calculating a reliability score for every cell embedding based on the similarity between the cell’s 2D-embedding neighbors and pre-embedding neighbors, {scDEED} identifies the cell embeddings with low reliability scores as dubious and those with high reliability scores as trustworthy. Moreover, by minimizing the number of dubious cell embeddings, {scDEED} provides intuitive guidance for optimizing the hyperparameters of an embedding method. We show the effectiveness of {scDEED} on multiple datasets for detecting dubious cell embeddings and optimizing the hyperparameters of t-{SNE} and {UMAP}.}
\field{day}{26}
\field{issn}{2041-1723}
\field{journaltitle}{Nature Communications}
\field{langid}{english}
\field{month}{2}
\field{note}{Publisher: Nature Publishing Group}
\field{number}{1}
\field{shortjournal}{Nat Commun}
\field{title}{Statistical method {scDEED} for detecting dubious 2D single-cell embeddings and optimizing t-{SNE} and {UMAP} hyperparameters}
\field{urlday}{10}
\field{urlmonth}{11}
\field{urlyear}{2024}
\field{volume}{15}
\field{year}{2024}
\field{dateera}{ce}
\field{urldateera}{ce}
\field{pages}{1753}
\range{pages}{1}
\verb{doi}
\verb 10.1038/s41467-024-45891-y
\endverb
\verb{urlraw}
\verb https://www.nature.com/articles/s41467-024-45891-y
\endverb
\verb{url}
\verb https://www.nature.com/articles/s41467-024-45891-y
\endverb
\keyw{Computational models,Data processing,Software,Statistical methods,Transcriptomics}
\endentry
\entry{liu_latent_2019}{article}{}{}
\name{author}{4}{}{%
{{hash=621013bf54d3546375ad71f17f020b5b}{%
family={Liu},
familyi={L\bibinitperiod},
given={Yang},
giveni={Y\bibinitperiod}}}%
{{hash=bbebc338bacad7030c36ed9a4c4cd674}{%
family={Jun},
familyi={J\bibinitperiod},
given={Eunice},
giveni={E\bibinitperiod}}}%
{{hash=133d1bd114428003bb5021533ee60551}{%
family={Li},
familyi={L\bibinitperiod},
given={Qisheng},
giveni={Q\bibinitperiod}}}%
{{hash=c1fc05b7156dc351ceebcc7f14fe27ee}{%
family={Heer},
familyi={H\bibinitperiod},
given={Jeffrey},
giveni={J\bibinitperiod}}}%
}
\strng{namehash}{df83681b9acfd53a0c867d0eb509f8f3}
\strng{fullhash}{ce312dfd52b6e846bf6ac989c49e3cca}
\strng{fullhashraw}{ce312dfd52b6e846bf6ac989c49e3cca}
\strng{bibnamehash}{df83681b9acfd53a0c867d0eb509f8f3}
\strng{authorbibnamehash}{df83681b9acfd53a0c867d0eb509f8f3}
\strng{authornamehash}{df83681b9acfd53a0c867d0eb509f8f3}
\strng{authorfullhash}{ce312dfd52b6e846bf6ac989c49e3cca}
\strng{authorfullhashraw}{ce312dfd52b6e846bf6ac989c49e3cca}
\field{sortinit}{1}
\field{sortinithash}{4f6aaa89bab872aa0999fec09ff8e98a}
\field{labelnamesource}{author}
\field{labeltitlesource}{shorttitle}
\field{abstract}{Latent spaces—reduced-dimensionality vector space embeddings of data, fit via machine learning—have been shown to capture interesting semantic properties and support data analysis and synthesis within a domain. Interpretation of latent spaces is challenging because prior knowledge, sometimes subtle and implicit, is essential to the process. We contribute methods for “latent space cartography”, the process of mapping and comparing meaningful semantic dimensions within latent spaces. We first perform a literature survey of relevant machine learning, natural language processing, and scientific research to distill common tasks and propose a workflow process. Next, we present an integrated visual analysis system for supporting this workflow, enabling users to discover, define, and verify meaningful relationships among data points, encoded within latent space dimensions. Three case studies demonstrate how users of our system can compare latent space variants in image generation, challenge existing findings on cancer transcriptomes, and assess a word embedding benchmark.}
\field{issn}{1467-8659}
\field{journaltitle}{Computer Graphics Forum}
\field{langid}{english}
\field{note}{\_eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1111/cgf.13672}
\field{number}{3}
\field{shorttitle}{Latent Space Cartography}
\field{title}{Latent Space Cartography: Visual Analysis of Vector Space Embeddings}
\field{urlday}{26}
\field{urlmonth}{10}
\field{urlyear}{2024}
\field{volume}{38}
\field{year}{2019}
\field{dateera}{ce}
\field{urldateera}{ce}
\field{pages}{67\bibrangedash 78}
\range{pages}{12}
\verb{doi}
\verb 10.1111/cgf.13672
\endverb
\verb{urlraw}
\verb https://onlinelibrary.wiley.com/doi/abs/10.1111/cgf.13672
\endverb
\verb{url}
\verb https://onlinelibrary.wiley.com/doi/abs/10.1111/cgf.13672
\endverb
\keyw{• Human-centered computing → Visualization,{CCS} Concepts,Visual analytics}
\endentry
\entry{macqueen_methods_1967}{incollection}{}{}
\name{author}{1}{}{%
{{hash=0a89c4966206844523ff4c8e6a12c281}{%
family={{MacQueen}},
familyi={M\bibinitperiod},
given={J.},
giveni={J\bibinitperiod}}}%
}
\list{publisher}{1}{%
{University of California Press}%
}
\strng{namehash}{0a89c4966206844523ff4c8e6a12c281}
\strng{fullhash}{0a89c4966206844523ff4c8e6a12c281}
\strng{fullhashraw}{0a89c4966206844523ff4c8e6a12c281}
\strng{bibnamehash}{0a89c4966206844523ff4c8e6a12c281}
\strng{authorbibnamehash}{0a89c4966206844523ff4c8e6a12c281}
\strng{authornamehash}{0a89c4966206844523ff4c8e6a12c281}
\strng{authorfullhash}{0a89c4966206844523ff4c8e6a12c281}
\strng{authorfullhashraw}{0a89c4966206844523ff4c8e6a12c281}
\field{sortinit}{1}
\field{sortinithash}{4f6aaa89bab872aa0999fec09ff8e98a}
\field{labelnamesource}{author}
\field{labeltitlesource}{title}
\field{booktitle}{Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, Volume 1: Statistics}
\field{day}{1}
\field{month}{1}
\field{title}{Some methods for classification and analysis of multivariate observations}
\field{urlday}{9}
\field{urlmonth}{11}
\field{urlyear}{2024}
\field{volume}{5.1}
\field{year}{1967}
\field{dateera}{ce}
\field{urldateera}{ce}
\field{pages}{281\bibrangedash 298}
\range{pages}{18}
\verb{urlraw}
\verb https://projecteuclid.org/ebooks/berkeley-symposium-on-mathematical-statistics-and-probability/Proceedings-of-the-Fifth-Berkeley-Symposium-on-Mathematical-Statistics-and/chapter/Some-methods-for-classification-and-analysis-of-multivariate-observations/bsmsp/1200512992
\endverb
\verb{url}
\verb https://projecteuclid.org/ebooks/berkeley-symposium-on-mathematical-statistics-and-probability/Proceedings-of-the-Fifth-Berkeley-Symposium-on-Mathematical-Statistics-and/chapter/Some-methods-for-classification-and-analysis-of-multivariate-observations/bsmsp/1200512992
\endverb
\endentry
\entry{jones_lipschitzian_1993}{article}{}{}
\name{author}{3}{}{%
{{hash=919c9769c6c3da45cb2e0a4311517eae}{%
family={Jones},
familyi={J\bibinitperiod},
given={D.\bibnamedelimi R.},
giveni={D\bibinitperiod\bibinitdelim R\bibinitperiod}}}%
{{hash=c80a9ddad60ea681edd6df600a8b0f55}{%
family={Perttunen},
familyi={P\bibinitperiod},
given={C.\bibnamedelimi D.},
giveni={C\bibinitperiod\bibinitdelim D\bibinitperiod}}}%
{{hash=c066ffd26b89b83f153c5e78ec247c4e}{%
family={Stuckman},
familyi={S\bibinitperiod},
given={B.\bibnamedelimi E.},
giveni={B\bibinitperiod\bibinitdelim E\bibinitperiod}}}%
}
\strng{namehash}{413e13cdc547d5e66def42ac4c7381de}
\strng{fullhash}{413e13cdc547d5e66def42ac4c7381de}
\strng{fullhashraw}{413e13cdc547d5e66def42ac4c7381de}
\strng{bibnamehash}{413e13cdc547d5e66def42ac4c7381de}
\strng{authorbibnamehash}{413e13cdc547d5e66def42ac4c7381de}
\strng{authornamehash}{413e13cdc547d5e66def42ac4c7381de}
\strng{authorfullhash}{413e13cdc547d5e66def42ac4c7381de}
\strng{authorfullhashraw}{413e13cdc547d5e66def42ac4c7381de}
\field{sortinit}{1}
\field{sortinithash}{4f6aaa89bab872aa0999fec09ff8e98a}
\field{labelnamesource}{author}
\field{labeltitlesource}{title}
\field{abstract}{We present a new algorithm for finding the global minimum of a multivariate function subject to simple bounds. The algorithm is a modification of the standard Lipschitzian approach that eliminates the need to specify a Lipschitz constant. This is done by carrying out simultaneous searches using all possible constants from zero to infinity. On nine standard test functions, the new algorithm converges in fewer function evaluations than most competing methods.}
\field{day}{1}
\field{issn}{1573-2878}
\field{journaltitle}{Journal of Optimization Theory and Applications}
\field{langid}{english}
\field{month}{10}
\field{number}{1}
\field{shortjournal}{J Optim Theory Appl}
\field{title}{Lipschitzian optimization without the Lipschitz constant}
\field{urlday}{28}
\field{urlmonth}{10}
\field{urlyear}{2024}
\field{volume}{79}
\field{year}{1993}
\field{dateera}{ce}
\field{urldateera}{ce}
\field{pages}{157\bibrangedash 181}
\range{pages}{25}
\verb{doi}
\verb 10.1007/BF00941892
\endverb
\verb{urlraw}
\verb https://doi.org/10.1007/BF00941892
\endverb
\verb{url}
\verb https://doi.org/10.1007/BF00941892
\endverb
\keyw{Global optimization,Lipschitzian optimization,space covering,space partitioning}
\endentry
\entry{koenker_quantile_2001}{article}{}{}
\name{author}{2}{}{%
{{hash=713ca648cccb03223d755f3f2ff51a5c}{%
family={Koenker},
familyi={K\bibinitperiod},
given={Roger},
giveni={R\bibinitperiod}}}%
{{hash=3a9da56328889542c3aa3484548bd439}{%
family={Hallock},
familyi={H\bibinitperiod},
given={Kevin\bibnamedelima F.},
giveni={K\bibinitperiod\bibinitdelim F\bibinitperiod}}}%
}
\strng{namehash}{a58f59ac8ef07590764939beb0d45ec4}
\strng{fullhash}{a58f59ac8ef07590764939beb0d45ec4}
\strng{fullhashraw}{a58f59ac8ef07590764939beb0d45ec4}
\strng{bibnamehash}{a58f59ac8ef07590764939beb0d45ec4}
\strng{authorbibnamehash}{a58f59ac8ef07590764939beb0d45ec4}
\strng{authornamehash}{a58f59ac8ef07590764939beb0d45ec4}
\strng{authorfullhash}{a58f59ac8ef07590764939beb0d45ec4}
\strng{authorfullhashraw}{a58f59ac8ef07590764939beb0d45ec4}
\field{sortinit}{1}
\field{sortinithash}{4f6aaa89bab872aa0999fec09ff8e98a}
\field{labelnamesource}{author}
\field{labeltitlesource}{title}
\field{abstract}{Quantile regression, as introduced by Koenker and Bassett (1978), may be viewed as an extension of classical least squares estimation of conditional mean models to the estimation of an ensemble of models for several conditional quantile functions. The central special case is the median regression estimator which minimizes a sum of absolute errors. Other conditional quantile functions are estimated by minimizing an asymmetrically weighted sum of absolute errors. Quantile regression methods are illustrated with applications to models for {CEO} pay, food expenditure, and infant birthweight.}
\field{issn}{0895-3309}
\field{journaltitle}{Journal of Economic Perspectives}
\field{langid}{english}
\field{month}{12}
\field{number}{4}
\field{title}{Quantile Regression}
\field{urlday}{6}
\field{urlmonth}{5}
\field{urlyear}{2025}
\field{volume}{15}
\field{year}{2001}
\field{dateera}{ce}
\field{urldateera}{ce}
\field{pages}{143\bibrangedash 156}
\range{pages}{14}
\verb{doi}
\verb 10.1257/jep.15.4.143
\endverb
\verb{urlraw}
\verb https://www.aeaweb.org/articles?id=10.1257/jep.15.4.143
\endverb
\verb{url}
\verb https://www.aeaweb.org/articles?id=10.1257/jep.15.4.143
\endverb
\keyw{Single Equation Models,Single Variables: General}
\endentry
\entry{alexandrov_deciphering_2013}{article}{}{}
\name{author}{5}{}{%
{{hash=0de3a32baeacf71da1f2ba37cdeec4f5}{%
family={Alexandrov},
familyi={A\bibinitperiod},
given={Ludmil\bibnamedelima B.},
giveni={L\bibinitperiod\bibinitdelim B\bibinitperiod}}}%
{{hash=ff51458699a4772d48423692c8435654}{%
family={Nik-Zainal},
familyi={N\bibinithyphendelim Z\bibinitperiod},
given={Serena},
giveni={S\bibinitperiod}}}%
{{hash=25f42660c089daf2caefa8f0e51de14e}{%
family={Wedge},
familyi={W\bibinitperiod},
given={David\bibnamedelima C.},
giveni={D\bibinitperiod\bibinitdelim C\bibinitperiod}}}%
{{hash=706941125e2fbe023122d64ec22935d9}{%
family={Campbell},
familyi={C\bibinitperiod},
given={Peter\bibnamedelima J.},
giveni={P\bibinitperiod\bibinitdelim J\bibinitperiod}}}%
{{hash=ad806ff572ce30b4ba798e20eb64ac83}{%
family={Stratton},
familyi={S\bibinitperiod},
given={Michael\bibnamedelima R.},
giveni={M\bibinitperiod\bibinitdelim R\bibinitperiod}}}%
}
\strng{namehash}{d9850907c2389586399f3232db58a9cc}
\strng{fullhash}{40c582423ea2784eecfd3e0e55638e52}
\strng{fullhashraw}{40c582423ea2784eecfd3e0e55638e52}
\strng{bibnamehash}{d9850907c2389586399f3232db58a9cc}
\strng{authorbibnamehash}{d9850907c2389586399f3232db58a9cc}
\strng{authornamehash}{d9850907c2389586399f3232db58a9cc}
\strng{authorfullhash}{40c582423ea2784eecfd3e0e55638e52}
\strng{authorfullhashraw}{40c582423ea2784eecfd3e0e55638e52}
\field{sortinit}{2}
\field{sortinithash}{8b555b3791beccb63322c22f3320aa9a}
\field{labelnamesource}{author}
\field{labeltitlesource}{title}
\field{day}{31}
\field{issn}{2211-1247}
\field{journaltitle}{Cell Reports}
\field{month}{1}
\field{note}{Publisher: Elsevier}
\field{number}{1}
\field{shortjournal}{Cell Reports}
\field{title}{Deciphering Signatures of Mutational Processes Operative in Human Cancer}
\field{urlday}{10}
\field{urlmonth}{11}
\field{urlyear}{2024}
\field{volume}{3}
\field{year}{2013}
\field{dateera}{ce}
\field{urldateera}{ce}
\field{pages}{246\bibrangedash 259}
\range{pages}{14}
\verb{doi}
\verb 10.1016/j.celrep.2012.12.008
\endverb
\verb{urlraw}
\verb https://www.cell.com/cell-reports/abstract/S2211-1247(12)00433-0
\endverb
\verb{url}
\verb https://www.cell.com/cell-reports/abstract/S2211-1247(12)00433-0
\endverb
\endentry
\entry{lecun_gradient-based_1998}{article}{}{}
\name{author}{4}{}{%
{{hash=c7a5b066431b979612b716532b228554}{%
family={Lecun},
familyi={L\bibinitperiod},
given={Y.},
giveni={Y\bibinitperiod}}}%
{{hash=bbfb0f3936c83b7b099561e6f0e32ef3}{%
family={Bottou},
familyi={B\bibinitperiod},
given={L.},
giveni={L\bibinitperiod}}}%
{{hash=419350ebbeb4eba5351469f378dee007}{%
family={Bengio},
familyi={B\bibinitperiod},
given={Y.},
giveni={Y\bibinitperiod}}}%
{{hash=00f962380d25c4d7f23fa6c7e926c3ed}{%
family={Haffner},
familyi={H\bibinitperiod},
given={P.},
giveni={P\bibinitperiod}}}%
}
\strng{namehash}{dd2ddc978fe083bcff1aa1379cd19643}
\strng{fullhash}{4dd3ca3cdc8023700c28169734d6ad61}
\strng{fullhashraw}{4dd3ca3cdc8023700c28169734d6ad61}
\strng{bibnamehash}{dd2ddc978fe083bcff1aa1379cd19643}
\strng{authorbibnamehash}{dd2ddc978fe083bcff1aa1379cd19643}
\strng{authornamehash}{dd2ddc978fe083bcff1aa1379cd19643}
\strng{authorfullhash}{4dd3ca3cdc8023700c28169734d6ad61}
\strng{authorfullhashraw}{4dd3ca3cdc8023700c28169734d6ad61}
\field{sortinit}{2}
\field{sortinithash}{8b555b3791beccb63322c22f3320aa9a}
\field{labelnamesource}{author}
\field{labeltitlesource}{title}
\field{abstract}{Multilayer neural networks trained with the back-propagation algorithm constitute the best example of a successful gradient based learning technique. Given an appropriate network architecture, gradient-based learning algorithms can be used to synthesize a complex decision surface that can classify high-dimensional patterns, such as handwritten characters, with minimal preprocessing. This paper reviews various methods applied to handwritten character recognition and compares them on a standard handwritten digit recognition task. Convolutional neural networks, which are specifically designed to deal with the variability of 2D shapes, are shown to outperform all other techniques. Real-life document recognition systems are composed of multiple modules including field extraction, segmentation recognition, and language modeling. A new learning paradigm, called graph transformer networks ({GTN}), allows such multimodule systems to be trained globally using gradient-based methods so as to minimize an overall performance measure. Two systems for online handwriting recognition are described. Experiments demonstrate the advantage of global training, and the flexibility of graph transformer networks. A graph transformer network for reading a bank cheque is also described. It uses convolutional neural network character recognizers combined with global training techniques to provide record accuracy on business and personal cheques. It is deployed commercially and reads several million cheques per day.}
\field{issn}{1558-2256}
\field{journaltitle}{Proceedings of the {IEEE}}
\field{month}{11}
\field{note}{Conference Name: Proceedings of the {IEEE}}
\field{number}{11}
\field{title}{Gradient-based learning applied to document recognition}
\field{urlday}{28}
\field{urlmonth}{10}
\field{urlyear}{2024}
\field{volume}{86}
\field{year}{1998}
\field{dateera}{ce}
\field{urldateera}{ce}
\field{pages}{2278\bibrangedash 2324}
\range{pages}{47}
\verb{doi}
\verb 10.1109/5.726791
\endverb
\verb{urlraw}
\verb https://ieeexplore.ieee.org/document/726791
\endverb
\verb{url}
\verb https://ieeexplore.ieee.org/document/726791
\endverb
\keyw{Character recognition,Feature extraction,Hidden Markov models,Machine learning,Multi-layer neural network,Neural networks,Optical character recognition software,Optical computing,Pattern recognition,Principal component analysis}
\endentry
\entry{lake_atlas_2023}{article}{}{}
\name{author}{50}{}{%
{{hash=73d9b2971cea1b0b423240c9b653e478}{%
family={Lake},
familyi={L\bibinitperiod},
given={Blue\bibnamedelima B.},
giveni={B\bibinitperiod\bibinitdelim B\bibinitperiod}}}%
{{hash=bdf21bceee483c823114d85b6062a67c}{%
family={Menon},
familyi={M\bibinitperiod},
given={Rajasree},
giveni={R\bibinitperiod}}}%
{{hash=fc8d6ba61be16f6b7c1744340103a9bb}{%
family={Winfree},
familyi={W\bibinitperiod},
given={Seth},
giveni={S\bibinitperiod}}}%
{{hash=34578fbcdb17ab1676007866e7be281f}{%
family={Hu},
familyi={H\bibinitperiod},
given={Qiwen},
giveni={Q\bibinitperiod}}}%
{{hash=23eb6a216fcb346510bd333f7dc889ef}{%
family={Melo\bibnamedelima Ferreira},
familyi={M\bibinitperiod\bibinitdelim F\bibinitperiod},
given={Ricardo},
giveni={R\bibinitperiod}}}%
{{hash=dffa897f4540b055e4812050b33673c5}{%
family={Kalhor},
familyi={K\bibinitperiod},
given={Kian},
giveni={K\bibinitperiod}}}%
{{hash=f2f45994a59a67542ff56b59f4a42247}{%
family={Barwinska},
familyi={B\bibinitperiod},
given={Daria},
giveni={D\bibinitperiod}}}%
{{hash=64574ea801a7bf0b1167e944b5205b6f}{%
family={Otto},
familyi={O\bibinitperiod},
given={Edgar\bibnamedelima A.},
giveni={E\bibinitperiod\bibinitdelim A\bibinitperiod}}}%
{{hash=bc02feee4b33f80a33f8c75e86c9e449}{%
family={Ferkowicz},
familyi={F\bibinitperiod},
given={Michael},
giveni={M\bibinitperiod}}}%
{{hash=3bfc8c964b3f11b9e959dcf4c6334b48}{%
family={Diep},
familyi={D\bibinitperiod},
given={Dinh},
giveni={D\bibinitperiod}}}%
{{hash=21eae3e7d5c2b849f4021e322add334d}{%
family={Plongthongkum},
familyi={P\bibinitperiod},
given={Nongluk},
giveni={N\bibinitperiod}}}%
{{hash=8b912b926802cd290dbb127a642b3ea7}{%
family={Knoten},
familyi={K\bibinitperiod},
given={Amanda},
giveni={A\bibinitperiod}}}%
{{hash=62adcc0a5bb834634a53a32f4ee21193}{%
family={Urata},
familyi={U\bibinitperiod},
given={Sarah},
giveni={S\bibinitperiod}}}%
{{hash=4082fb724c9cadc7f97147d61e7c4b07}{%
family={Mariani},
familyi={M\bibinitperiod},
given={Laura\bibnamedelima H.},
giveni={L\bibinitperiod\bibinitdelim H\bibinitperiod}}}%
{{hash=a56987c3f24aa6314e07dbeaed08bf6a}{%
family={Naik},
familyi={N\bibinitperiod},
given={Abhijit\bibnamedelima S.},
giveni={A\bibinitperiod\bibinitdelim S\bibinitperiod}}}%
{{hash=ed10338117444d4addbd15065cfb3bac}{%
family={Eddy},
familyi={E\bibinitperiod},
given={Sean},
giveni={S\bibinitperiod}}}%
{{hash=4ac36eed64badd6f195e86aeecd037a7}{%
family={Zhang},
familyi={Z\bibinitperiod},
given={Bo},
giveni={B\bibinitperiod}}}%
{{hash=471c49dd15af676a5f58e1283eb635ee}{%
family={Wu},
familyi={W\bibinitperiod},
given={Yan},
giveni={Y\bibinitperiod}}}%
{{hash=ee5b86948bf9539f8bd33d22f7c93fc2}{%
family={Salamon},
familyi={S\bibinitperiod},
given={Diane},
giveni={D\bibinitperiod}}}%
{{hash=9d73dc6a70537c8ce12a029c0348502d}{%
family={Williams},
familyi={W\bibinitperiod},
given={James\bibnamedelima C.},
giveni={J\bibinitperiod\bibinitdelim C\bibinitperiod}}}%
{{hash=03d3e23852937fa39b0e34246c4ecd1d}{%
family={Wang},
familyi={W\bibinitperiod},
given={Xin},
giveni={X\bibinitperiod}}}%
{{hash=a4647631214e791350f2fedc29f969f6}{%
family={Balderrama},
familyi={B\bibinitperiod},
given={Karol\bibnamedelima S.},
giveni={K\bibinitperiod\bibinitdelim S\bibinitperiod}}}%
{{hash=fb0e664d5a87767c6ffeb31ebe8a5d17}{%
family={Hoover},
familyi={H\bibinitperiod},
given={Paul\bibnamedelima J.},
giveni={P\bibinitperiod\bibinitdelim J\bibinitperiod}}}%
{{hash=8e4221f67e0c606ea9fb00701b65d2a4}{%
family={Murray},
familyi={M\bibinitperiod},
given={Evan},
giveni={E\bibinitperiod}}}%
{{hash=4dbe841cbf446a893b6170a47363a179}{%
family={Marshall},
familyi={M\bibinitperiod},
given={Jamie\bibnamedelima L.},
giveni={J\bibinitperiod\bibinitdelim L\bibinitperiod}}}%
{{hash=dddf5b52949c7ee09198e9dc96a9d210}{%
family={Noel},
familyi={N\bibinitperiod},
given={Teia},
giveni={T\bibinitperiod}}}%
{{hash=41951606eecd28f0d86d2fca8942c93e}{%
family={Vijayan},
familyi={V\bibinitperiod},
given={Anitha},
giveni={A\bibinitperiod}}}%
{{hash=89564d1c67603147c6c8420c470793a6}{%
family={Hartman},
familyi={H\bibinitperiod},
given={Austin},
giveni={A\bibinitperiod}}}%
{{hash=fa91db7fe68f65a4947983b89f69fd65}{%
family={Chen},
familyi={C\bibinitperiod},
given={Fei},
giveni={F\bibinitperiod}}}%
{{hash=9420bbecd724840a8727363d0b5c927a}{%
family={Waikar},
familyi={W\bibinitperiod},
given={Sushrut\bibnamedelima S.},
giveni={S\bibinitperiod\bibinitdelim S\bibinitperiod}}}%
{{hash=58146e330972139c500938cf7b29c0de}{%
family={Rosas},
familyi={R\bibinitperiod},
given={Sylvia\bibnamedelima E.},
giveni={S\bibinitperiod\bibinitdelim E\bibinitperiod}}}%
{{hash=1a4676dcc808521db80f1aceddd5a429}{%
family={Wilson},
familyi={W\bibinitperiod},
given={Francis\bibnamedelima P.},
giveni={F\bibinitperiod\bibinitdelim P\bibinitperiod}}}%
{{hash=1d87bd8e7010451b515b61926c871512}{%
family={Palevsky},
familyi={P\bibinitperiod},
given={Paul\bibnamedelima M.},
giveni={P\bibinitperiod\bibinitdelim M\bibinitperiod}}}%
{{hash=57cd8697b006f1eabe0992bafcb487dc}{%
family={Kiryluk},
familyi={K\bibinitperiod},
given={Krzysztof},
giveni={K\bibinitperiod}}}%
{{hash=8299900c4173f3e6fc452185e3d83046}{%
family={Sedor},
familyi={S\bibinitperiod},
given={John\bibnamedelima R.},
giveni={J\bibinitperiod\bibinitdelim R\bibinitperiod}}}%
{{hash=8ca19be66f95869c5cc105c3237244f7}{%
family={Toto},
familyi={T\bibinitperiod},
given={Robert\bibnamedelima D.},
giveni={R\bibinitperiod\bibinitdelim D\bibinitperiod}}}%
{{hash=eca4461f32e45a603451a81435c40884}{%
family={Parikh},
familyi={P\bibinitperiod},
given={Chirag\bibnamedelima R.},
giveni={C\bibinitperiod\bibinitdelim R\bibinitperiod}}}%
{{hash=8e79a006d87976e6ff91e342a169cc4d}{%
family={Kim},
familyi={K\bibinitperiod},
given={Eric\bibnamedelima H.},
giveni={E\bibinitperiod\bibinitdelim H\bibinitperiod}}}%
{{hash=d06bc96caba8ec75d09d2d169fa958da}{%
family={Satija},
familyi={S\bibinitperiod},
given={Rahul},
giveni={R\bibinitperiod}}}%
{{hash=e9068e042e0f9b74cae71b656a0d1f07}{%
family={Greka},
familyi={G\bibinitperiod},
given={Anna},
giveni={A\bibinitperiod}}}%
{{hash=e9225335e0413d2a87ca9e4abe2f2e05}{%
family={Macosko},
familyi={M\bibinitperiod},
given={Evan\bibnamedelima Z.},
giveni={E\bibinitperiod\bibinitdelim Z\bibinitperiod}}}%
{{hash=7f4a1befbdf4ff9fee318034b865073e}{%
family={Kharchenko},
familyi={K\bibinitperiod},
given={Peter\bibnamedelima V.},
giveni={P\bibinitperiod\bibinitdelim V\bibinitperiod}}}%
{{hash=ba4173fbc9b8715b40d3b00665e9a878}{%
family={Gaut},
familyi={G\bibinitperiod},
given={Joseph\bibnamedelima P.},
giveni={J\bibinitperiod\bibinitdelim P\bibinitperiod}}}%
{{hash=8c562126b07cd7b3c6f5ca286410417c}{%
family={Hodgin},
familyi={H\bibinitperiod},
given={Jeffrey\bibnamedelima B.},
giveni={J\bibinitperiod\bibinitdelim B\bibinitperiod}}}%
{{hash=cbf419a3edd886179ad7049467d96eef}{%
family={Eadon},
familyi={E\bibinitperiod},
given={Michael\bibnamedelima T.},
giveni={M\bibinitperiod\bibinitdelim T\bibinitperiod}}}%
{{hash=4a6a56ab143a26625681c5cdebf7f656}{%
family={Dagher},
familyi={D\bibinitperiod},
given={Pierre\bibnamedelima C.},
giveni={P\bibinitperiod\bibinitdelim C\bibinitperiod}}}%
{{hash=113eb9d9243ef6e4d448f451139e5943}{%
family={El-Achkar},
familyi={E\bibinithyphendelim A\bibinitperiod},
given={Tarek\bibnamedelima M.},
giveni={T\bibinitperiod\bibinitdelim M\bibinitperiod}}}%
{{hash=62735e1af0391d63c09ff9fbcd3d4d54}{%
family={Zhang},
familyi={Z\bibinitperiod},
given={Kun},
giveni={K\bibinitperiod}}}%
{{hash=dad89398247c957102d5db16d6b48005}{%
family={Kretzler},
familyi={K\bibinitperiod},
given={Matthias},
giveni={M\bibinitperiod}}}%
{{hash=1a8372a58ceed5ab43b8bebf86f5e189}{%
family={Jain},
familyi={J\bibinitperiod},
given={Sanjay},
giveni={S\bibinitperiod}}}%
}
\strng{namehash}{263b88028cd3db0a513d79226c50fa96}
\strng{fullhash}{a8545603a0abcdbab587bbaa8ae93bd5}
\strng{fullhashraw}{a8545603a0abcdbab587bbaa8ae93bd5}
\strng{bibnamehash}{263b88028cd3db0a513d79226c50fa96}
\strng{authorbibnamehash}{263b88028cd3db0a513d79226c50fa96}
\strng{authornamehash}{263b88028cd3db0a513d79226c50fa96}
\strng{authorfullhash}{a8545603a0abcdbab587bbaa8ae93bd5}
\strng{authorfullhashraw}{a8545603a0abcdbab587bbaa8ae93bd5}
\field{sortinit}{2}
\field{sortinithash}{8b555b3791beccb63322c22f3320aa9a}
\field{labelnamesource}{author}
\field{labeltitlesource}{title}
\field{abstract}{Understanding kidney disease relies on defining the complexity of cell types and states, their associated molecular profiles and interactions within tissue neighbourhoods1. Here we applied multiple single-cell and single-nucleus assays ({>}400,000 nuclei or cells) and spatial imaging technologies to a broad spectrum of healthy reference kidneys (45 donors) and diseased kidneys (48 patients). This has provided a high-resolution cellular atlas of 51 main cell types, which include rare and previously undescribed cell populations. The multi-omic approach provides detailed transcriptomic profiles, regulatory factors and spatial localizations spanning the entire kidney. We also define 28 cellular states across nephron segments and interstitium that were altered in kidney injury, encompassing cycling, adaptive (successful or maladaptive repair), transitioning and degenerative states. Molecular signatures permitted the localization of these states within injury neighbourhoods using spatial transcriptomics, while large-scale 3D imaging analysis (around 1.2 million neighbourhoods) provided corresponding linkages to active immune responses. These analyses defined biological pathways that are relevant to injury time-course and niches, including signatures underlying epithelial repair that predicted maladaptive states associated with a decline in kidney function. This integrated multimodal spatial cell atlas of healthy and diseased human kidneys represents a comprehensive benchmark of cellular states, neighbourhoods, outcome-associated signatures and publicly available interactive visualizations.}
\field{issn}{1476-4687}
\field{journaltitle}{Nature}
\field{langid}{english}
\field{month}{7}
\field{note}{Publisher: Nature Publishing Group}
\field{number}{7970}
\field{title}{An atlas of healthy and injured cell states and niches in the human kidney}
\field{urlday}{9}
\field{urlmonth}{11}
\field{urlyear}{2024}
\field{volume}{619}
\field{year}{2023}
\field{dateera}{ce}
\field{urldateera}{ce}
\field{pages}{585\bibrangedash 594}
\range{pages}{10}
\verb{doi}
\verb 10.1038/s41586-023-05769-3
\endverb
\verb{urlraw}
\verb https://www.nature.com/articles/s41586-023-05769-3
\endverb
\verb{url}
\verb https://www.nature.com/articles/s41586-023-05769-3
\endverb
\keyw{Cellular signalling networks,Translational research}
\endentry
\entry{stark_rna_2019}{article}{}{}
\name{author}{3}{}{%
{{hash=d8a28f0428f599c565847016e208acd8}{%
family={Stark},
familyi={S\bibinitperiod},
given={Rory},
giveni={R\bibinitperiod}}}%
{{hash=1c561d7f76fafa13525da8f5afb3d89d}{%
family={Grzelak},
familyi={G\bibinitperiod},
given={Marta},
giveni={M\bibinitperiod}}}%
{{hash=5375f3baa3cb3755011118217840ca1f}{%
family={Hadfield},
familyi={H\bibinitperiod},
given={James},
giveni={J\bibinitperiod}}}%
}
\strng{namehash}{38f47fe4ecee1c1af79ee0a561a9a342}
\strng{fullhash}{38f47fe4ecee1c1af79ee0a561a9a342}
\strng{fullhashraw}{38f47fe4ecee1c1af79ee0a561a9a342}
\strng{bibnamehash}{38f47fe4ecee1c1af79ee0a561a9a342}
\strng{authorbibnamehash}{38f47fe4ecee1c1af79ee0a561a9a342}
\strng{authornamehash}{38f47fe4ecee1c1af79ee0a561a9a342}
\strng{authorfullhash}{38f47fe4ecee1c1af79ee0a561a9a342}
\strng{authorfullhashraw}{38f47fe4ecee1c1af79ee0a561a9a342}
\field{sortinit}{2}
\field{sortinithash}{8b555b3791beccb63322c22f3320aa9a}
\field{labelnamesource}{author}
\field{labeltitlesource}{shorttitle}
\field{abstract}{Over the past decade, {RNA} sequencing ({RNA}-seq) has become an indispensable tool for transcriptome-wide analysis of differential gene expression and differential splicing of {mRNAs}. However, as next-generation sequencing technologies have developed, so too has {RNA}-seq. Now, {RNA}-seq methods are available for studying many different aspects of {RNA} biology, including single-cell gene expression, translation (the translatome) and {RNA} structure (the structurome). Exciting new applications are being explored, such as spatial transcriptomics (spatialomics). Together with new long-read and direct {RNA}-seq technologies and better computational tools for data analysis, innovations in {RNA}-seq are contributing to a fuller understanding of {RNA} biology, from questions such as when and where transcription occurs to the folding and intermolecular interactions that govern {RNA} function.}
\field{issn}{1471-0064}
\field{journaltitle}{Nature Reviews Genetics}
\field{langid}{english}
\field{month}{11}
\field{note}{Publisher: Nature Publishing Group}
\field{number}{11}
\field{shortjournal}{Nat Rev Genet}
\field{shorttitle}{{RNA} sequencing}
\field{title}{{RNA} sequencing: the teenage years}
\field{urlday}{12}
\field{urlmonth}{5}
\field{urlyear}{2025}
\field{volume}{20}
\field{year}{2019}
\field{dateera}{ce}
\field{urldateera}{ce}
\field{pages}{631\bibrangedash 656}
\range{pages}{26}
\verb{doi}
\verb 10.1038/s41576-019-0150-2
\endverb
\verb{urlraw}
\verb https://www.nature.com/articles/s41576-019-0150-2
\endverb
\verb{url}
\verb https://www.nature.com/articles/s41576-019-0150-2
\endverb
\keyw{Gene expression,Gene expression analysis,Gene expression profiling,Next-generation sequencing,{RNA},{RNA} metabolism,{RNA} sequencing,Transcriptomics}
\endentry
\entry{heumos_best_2023}{article}{}{}
\name{author}{12}{}{%
{{hash=1b8601a329f8d7bc4a7bbba68ca11166}{%
family={Heumos},
familyi={H\bibinitperiod},
given={Lukas},
giveni={L\bibinitperiod}}}%
{{hash=58b8e80fd127403dfc24cac1e0360c58}{%
family={Schaar},
familyi={S\bibinitperiod},
given={Anna\bibnamedelima C.},
giveni={A\bibinitperiod\bibinitdelim C\bibinitperiod}}}%
{{hash=884ecbcfddd0eb73045dea286d05fbba}{%
family={Lance},
familyi={L\bibinitperiod},
given={Christopher},
giveni={C\bibinitperiod}}}%
{{hash=6a60e75fb0fe7fcd562eeadec2f0a235}{%
family={Litinetskaya},
familyi={L\bibinitperiod},
given={Anastasia},
giveni={A\bibinitperiod}}}%
{{hash=d4d8176bdd96cbf4caadd7a016011821}{%
family={Drost},
familyi={D\bibinitperiod},
given={Felix},
giveni={F\bibinitperiod}}}%
{{hash=3b7d170085943df15529b1a12dc40529}{%
family={Zappia},
familyi={Z\bibinitperiod},
given={Luke},
giveni={L\bibinitperiod}}}%
{{hash=0b8ba5e853f279b0b44111bf2f905311}{%
family={Lücken},
familyi={L\bibinitperiod},
given={Malte\bibnamedelima D.},
giveni={M\bibinitperiod\bibinitdelim D\bibinitperiod}}}%
{{hash=4b50a8f9b94e3d2da962d667c44d7c97}{%
family={Strobl},
familyi={S\bibinitperiod},
given={Daniel\bibnamedelima C.},
giveni={D\bibinitperiod\bibinitdelim C\bibinitperiod}}}%
{{hash=2b4014ae16f44acc710ba8b4da130052}{%
family={Henao},
familyi={H\bibinitperiod},
given={Juan},
giveni={J\bibinitperiod}}}%
{{hash=6c346857a29148516b82c38e6fa9be3a}{%
family={Curion},
familyi={C\bibinitperiod},
given={Fabiola},
giveni={F\bibinitperiod}}}%
{{hash=4e30dc5f041cc4c9b7fe2f5f4f20ebf3}{%
family={Schiller},
familyi={S\bibinitperiod},
given={Herbert\bibnamedelima B.},
giveni={H\bibinitperiod\bibinitdelim B\bibinitperiod}}}%
{{hash=e922f50549caa096ad5b259faec33127}{%
family={Theis},
familyi={T\bibinitperiod},
given={Fabian\bibnamedelima J.},
giveni={F\bibinitperiod\bibinitdelim J\bibinitperiod}}}%
}
\strng{namehash}{74488ce5197070c9110b19b434e3549e}
\strng{fullhash}{4b141415589b25154b94d66140c17873}
\strng{fullhashraw}{4b141415589b25154b94d66140c17873}
\strng{bibnamehash}{74488ce5197070c9110b19b434e3549e}
\strng{authorbibnamehash}{74488ce5197070c9110b19b434e3549e}
\strng{authornamehash}{74488ce5197070c9110b19b434e3549e}
\strng{authorfullhash}{4b141415589b25154b94d66140c17873}
\strng{authorfullhashraw}{4b141415589b25154b94d66140c17873}
\field{sortinit}{2}
\field{sortinithash}{8b555b3791beccb63322c22f3320aa9a}
\field{labelnamesource}{author}
\field{labeltitlesource}{title}
\field{abstract}{Recent advances in single-cell technologies have enabled high-throughput molecular profiling of cells across modalities and locations. Single-cell transcriptomics data can now be complemented by chromatin accessibility, surface protein expression, adaptive immune receptor repertoire profiling and spatial information. The increasing availability of single-cell data across modalities has motivated the development of novel computational methods to help analysts derive biological insights. As the field grows, it becomes increasingly difficult to navigate the vast landscape of tools and analysis steps. Here, we summarize independent benchmarking studies of unimodal and multimodal single-cell analysis across modalities to suggest comprehensive best-practice workflows for the most common analysis steps. Where independent benchmarks are not available, we review and contrast popular methods. Our article serves as an entry point for novices in the field of single-cell (multi-)omic analysis and guides advanced users to the most recent best practices.}
\field{issn}{1471-0064}
\field{journaltitle}{Nature Reviews Genetics}
\field{langid}{english}
\field{month}{8}
\field{note}{Publisher: Nature Publishing Group}
\field{number}{8}
\field{shortjournal}{Nat Rev Genet}
\field{title}{Best practices for single-cell analysis across modalities}
\field{urlday}{12}
\field{urlmonth}{5}
\field{urlyear}{2025}
\field{volume}{24}
\field{year}{2023}
\field{dateera}{ce}
\field{urldateera}{ce}
\field{pages}{550\bibrangedash 572}
\range{pages}{23}
\verb{doi}
\verb 10.1038/s41576-023-00586-w
\endverb
\verb{urlraw}
\verb https://www.nature.com/articles/s41576-023-00586-w
\endverb
\verb{url}
\verb https://www.nature.com/articles/s41576-023-00586-w
\endverb
\keyw{Functional genomics,Machine learning,{RNA} sequencing,Software}
\endentry
\entry{samuels_simpsons_1993}{article}{}{}
\name{author}{1}{}{%
{{hash=74003af05ad0c0576e03e253777decf9}{%
family={Samuels},
familyi={S\bibinitperiod},
given={Myra\bibnamedelima L.},
giveni={M\bibinitperiod\bibinitdelim L\bibinitperiod}}}%
}
\strng{namehash}{74003af05ad0c0576e03e253777decf9}
\strng{fullhash}{74003af05ad0c0576e03e253777decf9}
\strng{fullhashraw}{74003af05ad0c0576e03e253777decf9}
\strng{bibnamehash}{74003af05ad0c0576e03e253777decf9}
\strng{authorbibnamehash}{74003af05ad0c0576e03e253777decf9}
\strng{authornamehash}{74003af05ad0c0576e03e253777decf9}
\strng{authorfullhash}{74003af05ad0c0576e03e253777decf9}
\strng{authorfullhashraw}{74003af05ad0c0576e03e253777decf9}
\field{sortinit}{2}
\field{sortinithash}{8b555b3791beccb63322c22f3320aa9a}
\field{labelnamesource}{author}
\field{labeltitlesource}{title}
\field{abstract}{Simpson's paradox is viewed as one of a natural and coherent collection of association reversal phenomena that are of fundamental importance in statistical practice. Association reversal means that the direction of association between two variables X and Y is changed by collapsing (unconditioning) over a covariate Z; an example is Simpson's paradox for contingency tables. This article gives necessary and sufficient conditions for Simpson's paradox and for more general forms of association reversal. Close connections are noted with amalgamation paradoxes, defined as situations where an unconditional measure of association between X and Y lies outside the range of the conditional (on Z) measures. Emphasis throughout is on statistical interpretation and on commonalities and contrasts between the paradoxical phenomena in various settings.}
\field{day}{1}
\field{issn}{0162-1459}
\field{journaltitle}{Journal of the American Statistical Association}
\field{month}{3}
\field{note}{Publisher: {ASA} Website \_eprint: https://doi.org/10.1080/01621459.1993.10594297}
\field{number}{421}
\field{title}{Simpson's Paradox and Related Phenomena}
\field{urlday}{11}
\field{urlmonth}{5}
\field{urlyear}{2025}
\field{volume}{88}
\field{year}{1993}
\field{dateera}{ce}
\field{urldateera}{ce}
\field{pages}{81\bibrangedash 88}
\range{pages}{8}
\verb{doi}
\verb 10.1080/01621459.1993.10594297
\endverb
\verb{urlraw}
\verb https://doi.org/10.1080/01621459.1993.10594297
\endverb
\verb{url}
\verb https://doi.org/10.1080/01621459.1993.10594297
\endverb
\keyw{Amalgamation,Association,Confounding,Contingency table}
\endentry
\entry{rousseeuw_silhouettes_1987}{article}{}{}
\name{author}{1}{}{%
{{hash=72d8129c9f4e6afddacb834fb2d8226f}{%
family={Rousseeuw},
familyi={R\bibinitperiod},
given={Peter\bibnamedelima J.},
giveni={P\bibinitperiod\bibinitdelim J\bibinitperiod}}}%
}
\strng{namehash}{72d8129c9f4e6afddacb834fb2d8226f}
\strng{fullhash}{72d8129c9f4e6afddacb834fb2d8226f}
\strng{fullhashraw}{72d8129c9f4e6afddacb834fb2d8226f}
\strng{bibnamehash}{72d8129c9f4e6afddacb834fb2d8226f}
\strng{authorbibnamehash}{72d8129c9f4e6afddacb834fb2d8226f}
\strng{authornamehash}{72d8129c9f4e6afddacb834fb2d8226f}
\strng{authorfullhash}{72d8129c9f4e6afddacb834fb2d8226f}
\strng{authorfullhashraw}{72d8129c9f4e6afddacb834fb2d8226f}
\field{sortinit}{2}
\field{sortinithash}{8b555b3791beccb63322c22f3320aa9a}
\field{labelnamesource}{author}
\field{labeltitlesource}{shorttitle}
\field{abstract}{A new graphical display is proposed for partitioning techniques. Each cluster is represented by a so-called silhouette, which is based on the comparison of its tightness and separation. This silhouette shows which objects lie well within their cluster, and which ones are merely somewhere in between clusters. The entire clustering is displayed by combining the silhouettes into a single plot, allowing an appreciation of the relative quality of the clusters and an overview of the data configuration. The average silhouette width provides an evaluation of clustering validity, and might be used to select an ‘appropriate’ number of clusters.}
\field{day}{1}
\field{issn}{0377-0427}
\field{journaltitle}{Journal of Computational and Applied Mathematics}
\field{month}{11}
\field{shortjournal}{Journal of Computational and Applied Mathematics}
\field{shorttitle}{Silhouettes}
\field{title}{Silhouettes: A graphical aid to the interpretation and validation of cluster analysis}
\field{urlday}{11}
\field{urlmonth}{11}
\field{urlyear}{2024}
\field{volume}{20}
\field{year}{1987}
\field{dateera}{ce}
\field{urldateera}{ce}
\field{pages}{53\bibrangedash 65}
\range{pages}{13}
\verb{doi}
\verb 10.1016/0377-0427(87)90125-7
\endverb
\verb{urlraw}
\verb https://www.sciencedirect.com/science/article/pii/0377042787901257
\endverb
\verb{url}
\verb https://www.sciencedirect.com/science/article/pii/0377042787901257
\endverb
\keyw{classification,cluster analysis,clustering validity,Graphical display}
\endentry
\entry{fang_gseapy}{article}{}{}
\name{author}{3}{}{%
{{hash=995e94d585e069fb3d338582a008671b}{%
family={Fang},
familyi={F\bibinitperiod},
given={Zhuoqing},
giveni={Z\bibinitperiod}}}%
{{hash=5a3c9be003df3c427097191f13cf8e72}{%
family={Liu},
familyi={L\bibinitperiod},
given={Xinyuan},
giveni={X\bibinitperiod}}}%
{{hash=f11aac361b7c6469f985b68b30d6b9f3}{%
family={Peltz},
familyi={P\bibinitperiod},
given={Gary},
giveni={G\bibinitperiod}}}%
}
\strng{namehash}{d2a3c0454c98b724a0196b90da64c87b}
\strng{fullhash}{d2a3c0454c98b724a0196b90da64c87b}
\strng{fullhashraw}{d2a3c0454c98b724a0196b90da64c87b}
\strng{bibnamehash}{d2a3c0454c98b724a0196b90da64c87b}
\strng{authorbibnamehash}{d2a3c0454c98b724a0196b90da64c87b}
\strng{authornamehash}{d2a3c0454c98b724a0196b90da64c87b}
\strng{authorfullhash}{d2a3c0454c98b724a0196b90da64c87b}
\strng{authorfullhashraw}{d2a3c0454c98b724a0196b90da64c87b}
\field{sortinit}{2}
\field{sortinithash}{8b555b3791beccb63322c22f3320aa9a}
\field{labelnamesource}{author}
\field{labeltitlesource}{title}
\field{abstract}{Gene set enrichment analysis (GSEA) is a commonly used algorithm for characterizing gene expression changes. However, the currently available tools used to perform GSEA have a limited ability to analyze large datasets, which is particularly problematic for the analysis of single-cell data. To overcome this limitation, we developed a GSEA package in Python (GSEApy), which could efficiently analyze large single-cell datasets.We present a package (GSEApy) that performs GSEA in either the command line or Python environment. GSEApy uses a Rust implementation to enable it to calculate the same enrichment statistic as GSEA for a collection of pathways. The Rust implementation of GSEApy is 3-fold faster than the Numpy version of GSEApy (v0.10.8) and uses \>4-fold less memory. GSEApy also provides an interface between Python and Enrichr web services, as well as for BioMart. The Enrichr application programming interface enables GSEApy to perform over-representation analysis for an input gene list. Furthermore, GSEApy consists of several tools, each designed to facilitate a particular type of enrichment analysis.The new GSEApy with Rust extension is deposited in PyPI: https://pypi.org/project/gseapy/. The GSEApy source code is freely available at https://github.com/zqfang/GSEApy. Also, the documentation website is available at https://gseapy.rtfd.io/.Supplementary data are available at Bioinformatics online.}
\field{issn}{1367-4811}
\field{journaltitle}{Bioinformatics}
\field{month}{11}
\field{number}{1}
\field{title}{GSEApy: a comprehensive package for performing gene set enrichment analysis in Python}
\field{volume}{39}
\field{year}{2022}
\field{pages}{btac757}
\range{pages}{-1}
\verb{doi}
\verb 10.1093/bioinformatics/btac757
\endverb
\verb{eprint}
\verb https://academic.oup.com/bioinformatics/article-pdf/39/1/btac757/48448971/btac757.pdf
\endverb
\verb{urlraw}
\verb https://doi.org/10.1093/bioinformatics/btac757
\endverb
\verb{url}
\verb https://doi.org/10.1093/bioinformatics/btac757
\endverb
\endentry
\entry{patera_kidney_2024}{article}{}{}
\name{author}{5}{}{%
{{hash=48792b3d58ff8503255a11407db85620}{%
family={Patera},
familyi={P\bibinitperiod},
given={Francesco},
giveni={F\bibinitperiod}}}%
{{hash=2bc4484d0070e14aab90278166af466e}{%
family={Gatticchi},
familyi={G\bibinitperiod},
given={Leonardo},
giveni={L\bibinitperiod}}}%
{{hash=a38ced0ad402d6080cd993cf0d21b4df}{%
family={Cellini},
familyi={C\bibinitperiod},
given={Barbara},
giveni={B\bibinitperiod}}}%
{{hash=9cb4268d641b09481fa4ba45d534116f}{%
family={Chiasserini},
familyi={C\bibinitperiod},
given={Davide},
giveni={D\bibinitperiod}}}%
{{hash=aa69b868cefdcf50669ce175323447bd}{%
family={Reboldi},
familyi={R\bibinitperiod},
given={Gianpaolo},
giveni={G\bibinitperiod}}}%
}
\strng{namehash}{ddaee7ae46ba20ca42be30fbacfea255}
\strng{fullhash}{28c59bb25db3f73e26131e19abb0b144}
\strng{fullhashraw}{28c59bb25db3f73e26131e19abb0b144}
\strng{bibnamehash}{ddaee7ae46ba20ca42be30fbacfea255}
\strng{authorbibnamehash}{ddaee7ae46ba20ca42be30fbacfea255}
\strng{authornamehash}{ddaee7ae46ba20ca42be30fbacfea255}
\strng{authorfullhash}{28c59bb25db3f73e26131e19abb0b144}
\strng{authorfullhashraw}{28c59bb25db3f73e26131e19abb0b144}
\field{sortinit}{3}
\field{sortinithash}{ad6fe7482ffbd7b9f99c9e8b5dccd3d7}
\field{labelnamesource}{author}
\field{labeltitlesource}{shorttitle}
\field{abstract}{Kidney fibrosis, diffused into the interstitium, vessels, and glomerulus, is the main pathologic feature associated with loss of renal function and chronic kidney disease ({CKD}). Fibrosis may be triggered in kidney diseases by different genetic and molecular insults. However, several studies have shown that fibrosis can be linked to oxidative stress and mitochondrial dysfunction in {CKD}. In this review, we will focus on three pathways that link oxidative stress and kidney fibrosis, namely: (i) hyperglycemia and mitochondrial energy imbalance, (ii) the mineralocorticoid signaling pathway, and (iii) the hypoxia-inducible factor ({HIF}) pathway. We selected these pathways because they are targeted by available medications capable of reducing kidney fibrosis, such as sodium-glucose cotransporter-2 ({SGLT}2) inhibitors, non-steroidal mineralocorticoid receptor antagonists ({MRAs}), and {HIF}-1alpha-prolyl hydroxylase inhibitors. These drugs have shown a reduction in oxidative stress in the kidney and a reduced collagen deposition across different {CKD} subtypes. However, there is still a long and winding road to a clear understanding of the anti-fibrotic effects of these compounds in humans, due to the inherent practical and ethical difficulties in obtaining sequential kidney biopsies and the lack of specific fibrosis biomarkers measurable in easily accessible matrices like urine. In this narrative review, we will describe these three pathways, their interconnections, and their link to and activity in oxidative stress and kidney fibrosis.}
\field{issn}{2218-273X}
\field{journaltitle}{Biomolecules}
\field{langid}{english}
\field{month}{1}
\field{note}{Number: 1 Publisher: Multidisciplinary Digital Publishing Institute}
\field{number}{1}
\field{shorttitle}{Kidney Fibrosis and Oxidative Stress}
\field{title}{Kidney Fibrosis and Oxidative Stress: From Molecular Pathways to New Pharmacological Opportunities}
\field{urlday}{14}
\field{urlmonth}{5}
\field{urlyear}{2025}
\field{volume}{14}
\field{year}{2024}
\field{dateera}{ce}
\field{urldateera}{ce}
\field{pages}{137}
\range{pages}{1}
\verb{doi}
\verb 10.3390/biom14010137
\endverb
\verb{urlraw}
\verb https://www.mdpi.com/2218-273X/14/1/137
\endverb
\verb{url}
\verb https://www.mdpi.com/2218-273X/14/1/137
\endverb
\keyw{hypoxia-inducible factor,kidney fibrosis,mineralocorticoid signaling,mitochondrial energy imbalance,oxidative stress,sodium-glucose cotransporter 2}
\endentry
\entry{schupp_dna_2016}{article}{}{}
\name{author}{3}{}{%
{{hash=741ab9e0612a8ff9dfc562759f8cb03e}{%
family={Schupp},
familyi={S\bibinitperiod},
given={Nicole},
giveni={N\bibinitperiod}}}%
{{hash=9d6b3c44030dcbf20019d5ddfcc28eb1}{%
family={Stopper},
familyi={S\bibinitperiod},
given={Helga},
giveni={H\bibinitperiod}}}%
{{hash=49f1de9057af2fa0b3b789ace1c041e6}{%
family={Heidland},
familyi={H\bibinitperiod},
given={August},
giveni={A\bibinitperiod}}}%
}
\strng{namehash}{bd2927f4f25bd1397b2e11fc40e74cef}
\strng{fullhash}{bd2927f4f25bd1397b2e11fc40e74cef}
\strng{fullhashraw}{bd2927f4f25bd1397b2e11fc40e74cef}
\strng{bibnamehash}{bd2927f4f25bd1397b2e11fc40e74cef}
\strng{authorbibnamehash}{bd2927f4f25bd1397b2e11fc40e74cef}
\strng{authornamehash}{bd2927f4f25bd1397b2e11fc40e74cef}
\strng{authorfullhash}{bd2927f4f25bd1397b2e11fc40e74cef}
\strng{authorfullhashraw}{bd2927f4f25bd1397b2e11fc40e74cef}
\field{sortinit}{3}
\field{sortinithash}{ad6fe7482ffbd7b9f99c9e8b5dccd3d7}
\field{labelnamesource}{author}
\field{labeltitlesource}{shorttitle}
\field{abstract}{Patients with chronic kidney disease ({CKD}) exhibit an increased cancer risk compared to a healthy control population. To be able to estimate the cancer risk of the patients and to assess the impact of interventional therapies thereon, it is of particular interest to measure the patients? burden of genomic damage. Chromosomal abnormalities, reduced {DNA} repair, and {DNA} lesions were found indeed in cells of patients with {CKD}. Biomarkers for {DNA} damage measurable in easily accessible cells like peripheral blood lymphocytes are chromosomal aberrations, structural {DNA} lesions, and oxidatively modified {DNA} bases. In this review the most common methods quantifying the three parameters mentioned above, the cytokinesis-block micronucleus assay, the comet assay, and the quantification of 8-oxo-7,8-dihydro-2?-deoxyguanosine, are evaluated concerning the feasibility of the analysis and regarding the marker?s potential to predict clinical outcomes.}
\field{issn}{1942-0900}
\field{journaltitle}{Oxidative Medicine and Cellular Longevity}
\field{month}{1}
\field{note}{Publisher: John Wiley \& Sons, Ltd}
\field{number}{1}
\field{shorttitle}{{DNA} Damage in Chronic Kidney Disease}
\field{title}{{DNA} Damage in Chronic Kidney Disease: Evaluation of Clinical Biomarkers}
\field{urlday}{14}
\field{urlmonth}{5}
\field{urlyear}{2025}
\field{volume}{2016}
\field{year}{2016}
\field{dateera}{ce}
\field{urldateera}{ce}
\field{pages}{3592042}
\range{pages}{1}
\verb{doi}
\verb 10.1155/2016/3592042
\endverb
\verb{urlraw}
\verb https://onlinelibrary.wiley.com/doi/10.1155/2016/3592042
\endverb
\verb{url}
\verb https://onlinelibrary.wiley.com/doi/10.1155/2016/3592042
\endverb
\endentry
\entry{molitoris_dna_nodate}{article}{}{}
\name{author}{1}{}{%
{{hash=f80006b6b5c85f2858967b0c353c9c35}{%
family={Molitoris},
familyi={M\bibinitperiod},
given={Bruce\bibnamedelima A.},
giveni={B\bibinitperiod\bibinitdelim A\bibinitperiod}}}%
}
\strng{namehash}{f80006b6b5c85f2858967b0c353c9c35}
\strng{fullhash}{f80006b6b5c85f2858967b0c353c9c35}
\strng{fullhashraw}{f80006b6b5c85f2858967b0c353c9c35}
\strng{bibnamehash}{f80006b6b5c85f2858967b0c353c9c35}
\strng{authorbibnamehash}{f80006b6b5c85f2858967b0c353c9c35}
\strng{authornamehash}{f80006b6b5c85f2858967b0c353c9c35}
\strng{authorfullhash}{f80006b6b5c85f2858967b0c353c9c35}
\strng{authorfullhashraw}{f80006b6b5c85f2858967b0c353c9c35}
\field{sortinit}{3}
\field{sortinithash}{ad6fe7482ffbd7b9f99c9e8b5dccd3d7}
\field{labelnamesource}{author}
\field{labeltitlesource}{title}
\field{abstract}{The pathophysiology of cellular injury and repair has been extensively studied in acute kidney injury ({AKI}) for more than 70 years. Although a great deal of knowledge has been generated, a debate over the importance of repairing damaged cells versus replacing them by proliferation remains. In this issue of the {JCI}, Kishi et al. demonstrate that following kidney epithelial cell injury, {DNA} repair, rather than cell proliferation, plays the central role in recovery and longevity by minimizing apoptosis, G2/M cell-cycle arrest, and subsequent fibrosis. This has important therapeutic implications and highlights the need for more sensitive techniques to evaluate functional, structural, and molecular recovery following injury.}
\field{issn}{0021-9738}
\field{journaltitle}{The Journal of Clinical Investigation}
\field{number}{11}
\field{shortjournal}{J Clin Invest}
\field{title}{{DNA} damage response protects against progressive kidney disease}
\field{urlday}{14}
\field{urlmonth}{5}
\field{urlyear}{2025}
\field{volume}{129}
\field{urldateera}{ce}
\field{pages}{4574\bibrangedash 4575}
\range{pages}{2}
\verb{doi}
\verb 10.1172/JCI131171
\endverb
\verb{urlraw}
\verb https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6819138/
\endverb
\verb{url}
\verb https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6819138/
\endverb
\endentry
\entry{wang_roles_2023}{article}{}{}
\name{author}{5}{}{%
{{hash=9853252e8871ea286af6ef908f1ae73e}{%
family={Wang},
familyi={W\bibinitperiod},
given={Peipei},
giveni={P\bibinitperiod}}}%
{{hash=3b22fc8d419a08b9224470eb583709ef}{%
family={Ouyang},
familyi={O\bibinitperiod},
given={Jing},
giveni={J\bibinitperiod}}}%
{{hash=9716ea5023406c3ff314baeb69db4a1d}{%
family={Jia},
familyi={J\bibinitperiod},
given={Zhanjun},
giveni={Z\bibinitperiod}}}%
{{hash=9c709358b99545637726ab4282ea69fd}{%
family={Zhang},
familyi={Z\bibinitperiod},
given={Aihua},
giveni={A\bibinitperiod}}}%
{{hash=e0d019088b55a6ef397e1530c5b157e5}{%
family={Yang},
familyi={Y\bibinitperiod},
given={Yunwen},
giveni={Y\bibinitperiod}}}%
}
\strng{namehash}{5a122cef0b245fb70a77188f405a128b}
\strng{fullhash}{3c9eda880fc07fff2571f282e39dc8aa}
\strng{fullhashraw}{3c9eda880fc07fff2571f282e39dc8aa}
\strng{bibnamehash}{5a122cef0b245fb70a77188f405a128b}
\strng{authorbibnamehash}{5a122cef0b245fb70a77188f405a128b}
\strng{authornamehash}{5a122cef0b245fb70a77188f405a128b}
\strng{authorfullhash}{3c9eda880fc07fff2571f282e39dc8aa}
\strng{authorfullhashraw}{3c9eda880fc07fff2571f282e39dc8aa}
\field{extraname}{3}
\field{sortinit}{3}
\field{sortinithash}{ad6fe7482ffbd7b9f99c9e8b5dccd3d7}
\field{labelnamesource}{author}
\field{labeltitlesource}{title}
\field{abstract}{The prevalence of renal diseases including acute kidney injury ({AKI}) and chronic kidney disease ({CKD}) is increasing worldwide. However, the pathogenesis of most renal diseases is still unclear and effective treatments are still lacking. {DNA} damage and the related {DNA} damage response ({DDR}) have been confirmed as common pathogenesis of acute kidney injury and chronic kidney disease. Reactive oxygen species ({ROS}) induced {DNA} damage is one of the most common types of {DNA} damage involved in the pathogenesis of acute kidney injury and chronic kidney disease. In recent years, several developments have been made in the field of {DNA} damage. Herein, we review the roles and developments of {DNA} damage and {DNA} damage response in renal tubular epithelial cell injury in acute kidney injury and chronic kidney disease. In this review, we conclude that focusing on {DNA} damage and {DNA} damage response may provide valuable diagnostic biomarkers and treatment strategies for renal diseases including acute kidney injury and chronic kidney disease.}
\field{day}{6}
\field{issn}{1664-042X}
\field{journaltitle}{Frontiers in Physiology}
\field{month}{4}
\field{shortjournal}{Front Physiol}
\field{title}{Roles of {DNA} damage in renal tubular epithelial cells injury}
\field{urlday}{14}
\field{urlmonth}{5}
\field{urlyear}{2025}
\field{volume}{14}
\field{year}{2023}
\field{dateera}{ce}
\field{urldateera}{ce}
\field{pages}{1162546}
\range{pages}{1}
\verb{doi}
\verb 10.3389/fphys.2023.1162546
\endverb
\verb{urlraw}
\verb https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10117683/
\endverb
\verb{url}
\verb https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10117683/
\endverb
\endentry
\entry{crabbe_concept_2022}{inproceedings}{}{}
\name{author}{2}{}{%
{{hash=157950a321ecba7473a202bcf214a929}{%
family={Crabbé},
familyi={C\bibinitperiod},
given={Jonathan},
giveni={J\bibinitperiod}}}%
{{hash=44c5ebc1d90d166c1418c35650bdd2ef}{%
family={Schaar},
familyi={S\bibinitperiod},
given={Mihaela},
giveni={M\bibinitperiod},
prefix={van\bibnamedelima der},
prefixi={v\bibinitperiod\bibinitdelim d\bibinitperiod}}}%
}
\list{location}{1}{%
{Red Hook, {NY}, {USA}}%
}
\list{publisher}{1}{%
{Curran Associates Inc.}%
}
\strng{namehash}{5841d4c9db7e235b6a4ddba6583ad8c8}
\strng{fullhash}{5841d4c9db7e235b6a4ddba6583ad8c8}
\strng{fullhashraw}{5841d4c9db7e235b6a4ddba6583ad8c8}
\strng{bibnamehash}{5841d4c9db7e235b6a4ddba6583ad8c8}
\strng{authorbibnamehash}{5841d4c9db7e235b6a4ddba6583ad8c8}
\strng{authornamehash}{5841d4c9db7e235b6a4ddba6583ad8c8}
\strng{authorfullhash}{5841d4c9db7e235b6a4ddba6583ad8c8}
\strng{authorfullhashraw}{5841d4c9db7e235b6a4ddba6583ad8c8}
\field{sortinit}{3}
\field{sortinithash}{ad6fe7482ffbd7b9f99c9e8b5dccd3d7}
\field{labelnamesource}{author}
\field{labeltitlesource}{shorttitle}
\field{abstract}{Concept-based explanations permit to understand the predictions of a deep neural network ({DNN}) through the lens of concepts specified by users. Existing methods assume that the examples illustrating a concept are mapped in a fixed direction of the {DNN}'s latent space. When this holds true, the concept can be represented by a concept activation vector ({CAV}) pointing in that direction. In this work, we propose to relax this assumption by allowing concept examples to be scattered across different clusters in the {DNN}'s latent space. Each concept is then represented by a region of the {DNN}'s latent space that includes these clusters and that we call concept activation region ({CAR}). To formalize this idea, we introduce an extension of the {CAV} formalism that is based on the kernel trick and support vector classifiers. This {CAR} formalism yields global concept-based explanations and local concept-based feature importance. We prove that {CAR} explanations built with radial kernels are invariant under latent space isometries. In this way, {CAR} assigns the same explanations to latent spaces that have the same geometry. We further demonstrate empirically that {CARs} offer (1) more accurate descriptions of how concepts are scattered in the {DNN}'s latent space; (2) global explanations that are closer to human concept annotations and (3) concept-based feature importance that meaningfully relate concepts with each other. Finally, we use {CARs} to show that {DNNs} can autonomously rediscover known scientific concepts, such as the prostate cancer grading system.}
\field{booktitle}{Proceedings of the 36th International Conference on Neural Information Processing Systems}
\field{day}{28}
\field{isbn}{978-1-7138-7108-8}
\field{month}{11}
\field{series}{{NIPS} '22}
\field{shorttitle}{Concept activation regions}
\field{title}{Concept activation regions: a generalized framework for concept-based explanations}
\field{urlday}{11}
\field{urlmonth}{5}
\field{urlyear}{2025}
\field{year}{2022}
\field{dateera}{ce}
\field{urldateera}{ce}
\field{pages}{2590\bibrangedash 2607}
\range{pages}{18}
\endentry
\entry{connor_tale_2016}{inproceedings}{}{}
\name{author}{1}{}{%
{{hash=6af6ae4393034830aabb73ede55860a4}{%
family={Connor},
familyi={C\bibinitperiod},
given={Richard},
giveni={R\bibinitperiod}}}%
}
\name{editor}{3}{}{%
{{hash=42d4b9e9abdcc7fa69a572edcafa6e77}{%
family={Amsaleg},
familyi={A\bibinitperiod},
given={Laurent},
giveni={L\bibinitperiod}}}%
{{hash=3f5ba8771c6d99e9af9f7716ed7d180b}{%
family={Houle},
familyi={H\bibinitperiod},
given={Michael\bibnamedelima E.},
giveni={M\bibinitperiod\bibinitdelim E\bibinitperiod}}}%
{{hash=d5aa8a82c7032184011fd502a43e205a}{%
family={Schubert},
familyi={S\bibinitperiod},
given={Erich},
giveni={E\bibinitperiod}}}%
}
\list{location}{1}{%
{Cham}%
}
\list{publisher}{1}{%
{Springer International Publishing}%
}
\strng{namehash}{6af6ae4393034830aabb73ede55860a4}
\strng{fullhash}{6af6ae4393034830aabb73ede55860a4}
\strng{fullhashraw}{6af6ae4393034830aabb73ede55860a4}
\strng{bibnamehash}{6af6ae4393034830aabb73ede55860a4}
\strng{authorbibnamehash}{6af6ae4393034830aabb73ede55860a4}
\strng{authornamehash}{6af6ae4393034830aabb73ede55860a4}
\strng{authorfullhash}{6af6ae4393034830aabb73ede55860a4}
\strng{authorfullhashraw}{6af6ae4393034830aabb73ede55860a4}
\strng{editorbibnamehash}{d9df89ee0cc28b637ae4046a8ec6715b}
\strng{editornamehash}{d9df89ee0cc28b637ae4046a8ec6715b}
\strng{editorfullhash}{d9df89ee0cc28b637ae4046a8ec6715b}
\strng{editorfullhashraw}{d9df89ee0cc28b637ae4046a8ec6715b}
\field{sortinit}{3}
\field{sortinithash}{ad6fe7482ffbd7b9f99c9e8b5dccd3d7}
\field{labelnamesource}{author}
\field{labeltitlesource}{title}
\field{abstract}{There are many contexts where the definition of similarity in multivariate space requires to be based on the correlation, rather than absolute value, of the variables. Examples include classic {IR} measurements such as {TDF}/{IF} and {BM}25, client similarity measures based on collaborative filtering, feature analysis of chemical molecules, and biodiversity contexts.}
\field{booktitle}{Similarity Search and Applications}
\field{isbn}{978-3-319-46759-7}
\field{langid}{english}
\field{title}{A Tale of Four Metrics}
\field{year}{2016}
\field{dateera}{ce}
\field{pages}{210\bibrangedash 217}
\range{pages}{8}
\verb{doi}
\verb 10.1007/978-3-319-46759-7_16
\endverb
\keyw{Cosine Distance,Cosine Similarity,Information Retrieval,Query Threshold,Semantic Basis}
\endentry
\entry{steinwart_estimating_2011}{article}{}{}
\name{author}{2}{}{%
{{hash=1f7c81e5506fdab760978a8fb50f27a6}{%
family={Steinwart},
familyi={S\bibinitperiod},
given={Ingo},
giveni={I\bibinitperiod}}}%
{{hash=c91468862b55209b860caf7280039ce1}{%
family={Christmann},
familyi={C\bibinitperiod},
given={Andreas},
giveni={A\bibinitperiod}}}%
}
\strng{namehash}{8dbb7f7e5317a30e083c3a9d87e20d0b}
\strng{fullhash}{8dbb7f7e5317a30e083c3a9d87e20d0b}
\strng{fullhashraw}{8dbb7f7e5317a30e083c3a9d87e20d0b}
\strng{bibnamehash}{8dbb7f7e5317a30e083c3a9d87e20d0b}
\strng{authorbibnamehash}{8dbb7f7e5317a30e083c3a9d87e20d0b}
\strng{authornamehash}{8dbb7f7e5317a30e083c3a9d87e20d0b}
\strng{authorfullhash}{8dbb7f7e5317a30e083c3a9d87e20d0b}
\strng{authorfullhashraw}{8dbb7f7e5317a30e083c3a9d87e20d0b}
\field{sortinit}{3}
\field{sortinithash}{ad6fe7482ffbd7b9f99c9e8b5dccd3d7}
\field{labelnamesource}{author}
\field{labeltitlesource}{title}
\field{abstract}{The so-called pinball loss for estimating conditional quantiles is a well-known tool in both statistics and machine learning. So far, however, only little work has been done to quantify the efficiency of this tool for nonparametric approaches. We fill this gap by establishing inequalities that describe how close approximate pinball risk minimizers are to the corresponding conditional quantile. These inequalities, which hold under mild assumptions on the data-generating distribution, are then used to establish so-called variance bounds, which recently turned out to play an important role in the statistical analysis of (regularized) empirical risk minimization approaches. Finally, we use both types of inequalities to establish an oracle inequality for support vector machines that use the pinball loss. The resulting learning rates are min–max optimal under some standard regularity assumptions on the conditional quantile.}
\field{issn}{1350-7265}
\field{journaltitle}{Bernoulli}
\field{month}{2}
\field{note}{Publisher: Bernoulli Society for Mathematical Statistics and Probability}
\field{number}{1}
\field{title}{Estimating conditional quantiles with the help of the pinball loss}
\field{urlday}{21}
\field{urlmonth}{5}
\field{urlyear}{2025}
\field{volume}{17}
\field{year}{2011}
\field{dateera}{ce}
\field{urldateera}{ce}
\field{pages}{211\bibrangedash 225}
\range{pages}{15}
\verb{doi}
\verb 10.3150/10-BEJ267
\endverb
\verb{urlraw}
\verb https://projecteuclid.org/journals/bernoulli/volume-17/issue-1/Estimating-conditional-quantiles-with-the-help-of-the-pinball-loss/10.3150/10-BEJ267.full
\endverb
\verb{url}
\verb https://projecteuclid.org/journals/bernoulli/volume-17/issue-1/Estimating-conditional-quantiles-with-the-help-of-the-pinball-loss/10.3150/10-BEJ267.full
\endverb
\keyw{Nonparametric regression,Quantile estimation,Support vector machines}
\endentry
\entry{kingma_adam_2017}{misc}{}{}
\name{author}{2}{}{%
{{hash=b6fbd171848aad4edf3925543f1f1522}{%
family={Kingma},
familyi={K\bibinitperiod},
given={Diederik\bibnamedelima P.},
giveni={D\bibinitperiod\bibinitdelim P\bibinitperiod}}}%
{{hash=8aa66e8231cc2fdbe67aa4f18ca970c6}{%
family={Ba},
familyi={B\bibinitperiod},
given={Jimmy},
giveni={J\bibinitperiod}}}%
}
\list{publisher}{1}{%
{arXiv}%
}
\strng{namehash}{a09df9f123146b8e2c7f1134c9496932}
\strng{fullhash}{a09df9f123146b8e2c7f1134c9496932}
\strng{fullhashraw}{a09df9f123146b8e2c7f1134c9496932}
\strng{bibnamehash}{a09df9f123146b8e2c7f1134c9496932}
\strng{authorbibnamehash}{a09df9f123146b8e2c7f1134c9496932}
\strng{authornamehash}{a09df9f123146b8e2c7f1134c9496932}
\strng{authorfullhash}{a09df9f123146b8e2c7f1134c9496932}
\strng{authorfullhashraw}{a09df9f123146b8e2c7f1134c9496932}
\field{sortinit}{3}
\field{sortinithash}{ad6fe7482ffbd7b9f99c9e8b5dccd3d7}
\field{labelnamesource}{author}
\field{labeltitlesource}{shorttitle}
\field{abstract}{We introduce Adam, an algorithm for first-order gradient-based optimization of stochastic objective functions, based on adaptive estimates of lower-order moments. The method is straightforward to implement, is computationally efficient, has little memory requirements, is invariant to diagonal rescaling of the gradients, and is well suited for problems that are large in terms of data and/or parameters. The method is also appropriate for non-stationary objectives and problems with very noisy and/or sparse gradients. The hyper-parameters have intuitive interpretations and typically require little tuning. Some connections to related algorithms, on which Adam was inspired, are discussed. We also analyze the theoretical convergence properties of the algorithm and provide a regret bound on the convergence rate that is comparable to the best known results under the online convex optimization framework. Empirical results demonstrate that Adam works well in practice and compares favorably to other stochastic optimization methods. Finally, we discuss {AdaMax}, a variant of Adam based on the infinity norm.}
\field{day}{30}
\field{eprinttype}{arxiv}
\field{month}{1}
\field{number}{{arXiv}:1412.6980}
\field{shorttitle}{Adam}
\field{title}{Adam: A Method for Stochastic Optimization}
\field{urlday}{10}
\field{urlmonth}{11}
\field{urlyear}{2024}
\field{year}{2017}
\field{dateera}{ce}
\field{urldateera}{ce}
\verb{doi}
\verb 10.48550/arXiv.1412.6980
\endverb
\verb{eprint}
\verb 1412.6980
\endverb
\verb{urlraw}
\verb http://arxiv.org/abs/1412.6980
\endverb
\verb{url}
\verb http://arxiv.org/abs/1412.6980
\endverb
\keyw{Computer Science - Machine Learning}
\endentry
\entry{huang_bioinformatics_2009}{article}{}{}
\name{author}{3}{}{%
{{hash=a6a8c657c717866cf8a3c7c726351e34}{%
family={Huang},
familyi={H\bibinitperiod},
given={Da\bibnamedelima Wei},
giveni={D\bibinitperiod\bibinitdelim W\bibinitperiod}}}%
{{hash=e811580c19f84d9478097695882ad32c}{%
family={Sherman},
familyi={S\bibinitperiod},
given={Brad\bibnamedelima T.},
giveni={B\bibinitperiod\bibinitdelim T\bibinitperiod}}}%
{{hash=666b9a76b3ee2527ef33be97f319d410}{%
family={Lempicki},
familyi={L\bibinitperiod},
given={Richard\bibnamedelima A.},
giveni={R\bibinitperiod\bibinitdelim A\bibinitperiod}}}%
}
\strng{namehash}{10f87ea251501418b3d70e7ad337070c}
\strng{fullhash}{10f87ea251501418b3d70e7ad337070c}
\strng{fullhashraw}{10f87ea251501418b3d70e7ad337070c}
\strng{bibnamehash}{10f87ea251501418b3d70e7ad337070c}
\strng{authorbibnamehash}{10f87ea251501418b3d70e7ad337070c}
\strng{authornamehash}{10f87ea251501418b3d70e7ad337070c}
\strng{authorfullhash}{10f87ea251501418b3d70e7ad337070c}
\strng{authorfullhashraw}{10f87ea251501418b3d70e7ad337070c}
\field{sortinit}{3}
\field{sortinithash}{ad6fe7482ffbd7b9f99c9e8b5dccd3d7}
\field{labelnamesource}{author}
\field{labeltitlesource}{shorttitle}
\field{abstract}{Functional analysis of large gene lists, derived in most cases from emerging high-throughput genomic, proteomic and bioinformatics scanning approaches, is still a challenging and daunting task. The gene-annotation enrichment analysis is a promising high-throughput strategy that increases the likelihood for investigators to identify biological processes most pertinent to their study. Approximately 68 bioinformatics enrichment tools that are currently available in the community are collected in this survey. Tools are uniquely categorized into three major classes, according to their underlying enrichment algorithms. The comprehensive collections, unique tool classifications and associated questions/issues will provide a more comprehensive and up-to-date view regarding the advantages, pitfalls and recent trends in a simpler tool-class level rather than by a tool-by-tool approach. Thus, the survey will help tool designers/developers and experienced end users understand the underlying algorithms and pertinent details of particular tool categories/tools, enabling them to make the best choices for their particular research interests.}
\field{day}{1}
\field{issn}{0305-1048}
\field{journaltitle}{Nucleic Acids Research}
\field{month}{1}
\field{number}{1}
\field{shortjournal}{Nucleic Acids Research}
\field{shorttitle}{Bioinformatics enrichment tools}
\field{title}{Bioinformatics enrichment tools: paths toward the comprehensive functional analysis of large gene lists}
\field{urlday}{21}
\field{urlmonth}{5}
\field{urlyear}{2025}
\field{volume}{37}
\field{year}{2009}
\field{dateera}{ce}
\field{urldateera}{ce}
\field{pages}{1\bibrangedash 13}
\range{pages}{13}
\verb{doi}
\verb 10.1093/nar/gkn923
\endverb
\verb{urlraw}
\verb https://doi.org/10.1093/nar/gkn923
\endverb
\verb{url}
\verb https://doi.org/10.1093/nar/gkn923
\endverb
\endentry
\enddatalist
\endrefsection
\endinput