Citation Parsing and Analysis with Language Models
Extracted source text · arXiv 2505.15948
\documentclass{article} % For LaTeX2e
\usepackage{iclr2024_conference,times}
% Optional math commands from https://github.com/goodfeli/dlbook_notation.
\input{math_commands.tex}
\usepackage{hyperref}
\usepackage{url}
\usepackage[T1]{fontenc}
\usepackage{xcolor}
\definecolor{BrickRed}{rgb}{0.65,0.08,0.08}
% Prompt-formatting stack
\usepackage[most]{tcolorbox} % Boxed environments
\tcbuselibrary{skins,breakable}
\usepackage{lmodern}
\usepackage{subcaption}
\title{Citation Parsing and Analysis with Language Models}
% Authors must not appear in the submitted version. They should be hidden
% as long as the \iclrfinalcopy macro remains commented out below.
% Non-anonymous submissions will be rejected without review.
\author{parth sarin \\
Stanford University \\
Palo Alto, CA 94305, USA \\
\texttt{psarin@stanford.edu} \\
\And
Juan Pablo Alperin \\
Simon Fraser University \\
Vancouver, Canada \\
\texttt{juan@alperin.ca}
}
% The \author macro works with any number of authors. There are two commands
% used to separate the names and addresses of multiple authors: \And and \AND.
%
% Using \And between authors leaves it to \LaTeX{} to determine where to break
% the lines. Using \AND forces a linebreak at that point. So, if \LaTeX{}
% puts 3 of 4 authors names on the first line, and the last on the second
% line, try using \AND instead of \And before the third author name.
\newcommand{\fix}{\marginpar{FIX}}
\newcommand{\new}{\marginpar{NEW}}
\iclrfinalcopy % Uncomment for camera-ready version, but NOT for submission.
\begin{document}
\maketitle
\begin{abstract}
A key type of resource needed to address global inequalities in knowledge production and dissemination is a tool that can support journals in understanding how knowledge circulates. The absence of such a tool has resulted in comparatively less information about networks of knowledge sharing in the Global South. In turn, this gap authorizes the exclusion of researchers and scholars from the South in indexing services, reinforcing colonial arrangements that de-center and minoritize those scholars. In order to support citation network tracking on a global scale, we investigate the capacity of open-weight language models to mark up manuscript citations in an indexable format. We assembled a dataset of matched plaintext and annotated citations from preprints and published research papers. Then, we evaluated a number of open-weight language models on the annotation task. We find that, even out of the box, today's language models achieve high levels of accuracy on identifying the constituent components of each citation, outperforming state-of-the-art methods. Moreover, the smallest model we evaluated, Qwen3-0.6B, can parse all fields with high accuracy in $2^5$ passes, suggesting that post-training is likely to be effective in producing small, robust citation parsing models. Such a tool could greatly improve the fidelity of citation networks and thus meaningfully improve research indexing and discovery, as well as further metascientific research.
\end{abstract}
\section{Introduction}
Science is not an equal playing field. There is a large—though shrinking—inequality between knowledge production in the Global North and Global South. To properly understand this gap, national research capacities, and the broader power dynamics in global research contributions, it is necessary to have high quality and complete indexes of scholarly production. Accurate and complete metascientific information is also central to decision making at every level of the research system from the tenure and promotion decisions about individual faculty, to institutional resource allocation, and to national science policies. Such information is not indexed today: It has been observed for decades that research in the Global South is significantly underrepresented in supposedly global indexes, databases, and search engines for scholarly work \citep{cetto_scientific_1998,khanna_recalibrating_2022,mongeon_journal_2016}. So, for over 50 years, decisions about funding, tenure, collaboration, and governance have been made without the same type of reliable quantitative data that exists to tabulate research in the Global North.
Fortunately, a number of projects are seeking to address global gaps in indexing and discoverability. New bibliographic databases like OpenAlex are taking a more inclusive indexing approach that has allowed them to significantly outperform existing databases in terms of coverage \citep{alperin_analysis_2024,culbert_reference_2024,jiao_how_2023}. However, despite the significantly greater coverage of works, including those from the Global South, there continues to be an enormous gap in the indexing of references \citep{alperin_analysis_2024,culbert_reference_2024}. While more complete bibliographic records are useful for understanding knowledge production, references and citations allow us to better understand the connections and circulation of knowledge, and are thus an essential aspect of research information.
This is the project to which we seek to contribute. Namely, there has been recent interest in developing new citation parsing techniques that improve on state-of-the-art methods like GROBID and Crossref search to be performant in more languages and trainable end-to-end \citep{Choi2023BuildingAA,Joshi2023AnEP}. Though they were created through very extractive and neocolonial processes \citep{gray2019ghost,hao2024ai}, modern language models can indeed operate in multiple languages and modalities and they are end-to-end trainable. Some smaller language models can also run in low-compute environments, and even on mobile devices or in the browser.
In this paper, we evaluate open-source, decoder-based language models on the task of citation parsing. Specifically, we aim to address the following research questions:
\begin{enumerate}
\item How accurate are open-weight language models at identifying different components of a citation? How do they compare to state-of-the-art methods for reference parsing?
\item Are small language models — which can run in the browser or on a device — promising for this task?
\end{enumerate}
\section{Methods}
\subsection{Dataset}
We began by assembling a dataset of citations in plain, formatted text, along with the same citations marked up in JATS format. We drew from two existing corpora. First, \cite{garnett_xml_2016} assembled the ``XML Markup Evaluation Corpus,'' for the Public Knowledge Project (PKP) which includes 829 submitted article manuscripts marked up in JATS format. Second, Open Research Europe (ORE) is a publishing platform with an annotated corpus of 848 articles, marked up in JATS format \citep{openresearcheurope_corpus_2025}.
We extracted the marked up version of each citation from the reference list in the JATS XML markup and matched it to a (markdown-formatted) plaintext citation extracted from the article. Specifically, we converted each article to markdown using the \texttt{markitdown} tool \citep{markitdown2025}. Then, from that markdown, we extracted plaintext citations using Llama-3.1-8B-Instruct prompted with the system prompt in Appendix~\ref{sec:citation-extraction}. We programmatically verified that each of the citations appeared in the article to prevent hallucinated citations.
\begin{figure}[ht]
\centering
\begin{subfigure}[b]{0.48\linewidth}
\centering
\includegraphics[width=\linewidth]{img/pkp_similarity_kde.png}
\caption{Garnett/PKP Corpus}
\label{fig:pkp-similarity}
\end{subfigure}
\hfill
\begin{subfigure}[b]{0.48\linewidth}
\centering
\includegraphics[width=\linewidth]{img/ore_similarity_kde.png}
\caption{ORE Corpus}
\label{fig:ore-similarity}
\end{subfigure}
\caption{Similarity distributions for Garnett/PKP and ORE corpora}
\label{fig:similarity-kde}
\end{figure}
Then we matched the plaintext citations (the output of the language model) with the marked-up citations (provided in the XML files in each of the corpora). Let $p$ be the plaintext citation, $c$ be a text-only version of the marked-up citation, and $d(p, c)$ be the edit distance between the two. Take $|x|$ to represent the length (number of characters) of the string $x$. Define the \textit{similarity} between $p$ and $c$ to be \[ s(p, c) = 1 - \frac{d(p,c)}{\max\{|p|, |c|\}}. \] We matched citations in order of decreasing similarity and excluded all matches with a similarity score less than $0.75$. Figure~\ref{fig:similarity-kde} shows the distribution of similarity scores on the two corpora.
Applying this procedure, we produced 13,149 matches from the Garnett/PKP corpus and 24,934 from the ORE corpus. We sampled 1,000 citations from each for a final dataset of \textbf{2,000 matched citations} in plain text and marked up form.
We also qualitatively analyzed the matching procedure, specifically to investigate why the average similarity score is lower for the ORE corpus than the Garnett/PKP corpus. Our suspicion is that this happened because the ORE corpus is for published articles and references in that corpus can contain additional links which don't appear in the JATS markup. For example, here is one plaintext reference with a low similarity score:
\begin{tcolorbox}
Viswanathan M, Ammerman A, Eng E, et al.: Community-based participatory research: assessing the evidence. Evid Rep Technol Assess (Summ). AHRQ Publication N° 4-E022-1. Agency for Healthcare Research and Quality, Rockville, MD, 2004; (99): 1–8. \textbf{\color{BrickRed} PubMed Abstract | Free Full Text}
\end{tcolorbox}
In the published article, the highlighted section was linked to the PubMed abstract and full text of the article. The matched JATS annotation for this citation is correct but does not include those links, leading to a low score:
\begin{tcolorbox}
\begin{verbatim}
<mixed-citation publication-type="journal">
<person-group person-group-type="author">
<name name-style="western">
<surname>Viswanathan</surname>
<given-names>M</given-names>
</name>
<name name-style="western">
<surname>Ammerman</surname>
<given-names>A</given-names>
</name>
<name name-style="western">
<surname>Eng</surname>
<given-names>E</given-names>
</name>
<etal />
</person-group>:
<article-title>
Community-based participatory research:
assessing the evidence.
</article-title>
<source>
<italic toggle="yes">Evid Rep Technol Assess (Summ).</italic>
</source>
AHRQ Publication N° 4-E022-1.
Agency for Healthcare Research and Quality, Rockville, MD,
<year>2004</year>; (<issue>99</issue>):
<fpage>1</fpage>–<lpage>8</lpage>.
</mixed-citation>
\end{verbatim}
\end{tcolorbox}
\subsection{Language model evaluation}
Table~\ref{table:language-models} shows the language models we evaluated in this project. We chose small models that could potentially be deployed in low-compute contexts, given that a reference annotation service will likely need to run in the browser or on the server of a journal which may not have much compute capacity.
\begin{table}[htbp]
\centering
\caption{Model scale, maximum context length, and release date}
\begin{tabular}{lrrr}
% \hline
\textbf{Model (HuggingFace repo)} &
\textbf{Params (B)} &
\textbf{Context} &
\textbf{First release} \vspace{0.1cm} \\ \hline \hline \vspace{-0.2cm} \\
deepseek-ai/DeepSeek-R1-Distill-Qwen-14B & 14 & 32,768 & Feb 2025\\
deepseek-ai/DeepSeek-R1-Distill-Qwen-7B & 7 & 32,768 & Feb 2025\\
Qwen/Qwen2.5-7B-Instruct & 7.6 & 131,072 & Apr 2025\\
Qwen/Qwen2.5-3B-Instruct & 3.1 & 32,768 & Apr 2025\\
Qwen/Qwen3-4B & 4.0 & 32,768 & May 2025\\
Qwen/Qwen3-1.7B & 1.7 & 32,768 & May 2025\\
Qwen/Qwen3-0.6B & 0.6 & 32,768 & Apr 2025\\
microsoft/phi-4 & 14 & 16,000 & Dec 2024\\
microsoft/Phi4-mini-instruct & 3.8 & 128,000 & Feb 2025\\
meta-llama/Llama-3.1-8B-Instruct & 8 & 128,000 & Jul 2024\\
meta-llama/Llama-3.2-3B-Instruct & 3 & 128,000 & Sep 2024\\
\hline
\end{tabular}
\label{table:language-models}
\end{table}
Each model was prompted with two examples of marked-up citations (from the larger dataset, not the sampled 2,000) and instructed to produce the XML citation for a particular citation. We prompted the model twice, with and without a chain of thought. For the reasoning models, we explicitly foreclosed its reasoning by appending \verb|<think></think>| to the end of the prompt. When we sampled a chain of thought, we sampled at temperature $0.6$, with top $p$ set to $0.95$ and top $k$ set to $20$. For the non-CoT prompts we sampled at temperature $0.7$ with a top $p$ value of $0.8$ and top $k$ of $20$. In the results, we report the \verb|pass@1| accuracies for each model.
We evaluated the language model's accuracy on a number of citation sub-elements: \verb|article-title|, \verb|issue|, \verb|volume|, \verb|source|, \verb|coverage|, \verb|year|, \verb|fpage|, and \verb|surname| (the first author's surname). For each field except \verb|article-title| and \verb|source|, we required that the prediction exactly match the label. We allowed for an edit distance of $10$ for the article title and $5$ for the source. We also recorded the coverage, or the percent of citations for which the language model produced valid XML. If the language model did not produce valid XML, its label was marked incorrect for all sub-elements.
We also sampled $2^6 = 64$ completions for each citation, with a reasoning trace, from Qwen3-0.6B to determine whether this task is in distribution for a small model.
Running these experiments (\verb|pass@1| accuracies for eleven models and \verb|pass@64| accuracy for one model) took six hours on an H200 GPU. Based on our estimates, including the CO$_2$ emissions of the GPU and the datacenter, these experiments required at most 2.46 kg CO$_2$, or roughly the emissions incurred by driving the average U.S. gasoline-powered passenger vehicle 6.3 miles. See Appendix~\ref{sec:energy-consumption} for a more detailed calculation.
\section{Results}
\subsection{RQ1: Model accuracies}
Figure~\ref{fig:model-accuracies} shows the accuracies of these models on the 2,000 citations. We report the highest \verb|pass@1| accuracy for each field across the two prompts (with and without a chain of thought).
\begin{figure}[ht]
\centering
\includegraphics[width=0.9\linewidth]{img/best_model_accuracies_heatmap.png}
\caption{\texttt{pass@1} model accuracies, max between CoT and non-CoT prompts}
\label{fig:model-accuracies}
\end{figure}
We also conducted a quick evaluation of Crossref search for these references. Crossref had coverage of $0.968$ with an article title accuracy of $0.439$. The API also provides a ``confidence'' score. Filtering only to high confidence items (a score of larger than $50$), this approach has a coverage of $0.632$ with an article title accuracy of $0.633$. Both of these accuracies are lower than the worse-performing language models.
We did a similar evaluation of GROBID using the \verb|/api/processCitation| endpoint. It had a coverage of $0.989$ with an article title accuracy of $0.6674$ and a surname accuracy of $0.8516$. The worst performing language model does better by $8.76$ percentage points for article title accuracy and most language models (except for the worst two) also have a higher accuracy for surname identification.
\subsection{RQ2: Small language models}\label{sec:small-lm-distribution}
\cite{yue2025doesreinforcementlearningreally} demonstrated that the capacity of a language model to learn a task using reinforcement learning with verifiable reward (RLVR) is strongly connected to the base model's \verb|pass@k| performance on the task. This provides one technique to determine whether high-fidelity citation parsing is within the distribution of a small model.
\begin{figure}[ht]
\centering
\includegraphics[width=0.9\linewidth]{img/Qwen3-0.6B-passk.png}
\caption{\texttt{pass@64} accuracy for Qwen3-0.6B on citation parsing}
\label{fig:qwen3-0.6b-pass@k}
\end{figure}
Figure~\ref{fig:qwen3-0.6b-pass@k} shows whether the correct answer for each sub-element appears within $64$ samples, with reasoning, from Qwen3-0.6B. It shows that this task (over 90\% accuracy for all sub-elements) is within distribution for the model and that the standard RLVR setup is likely to improve sampling efficiency.
\section{Discussion}
This short report has demonstrated the capacity of language models to achieve high accuracy at marking up the different components of a plaintext citation. Specifically, the models evaluated in this study generally achieve higher field accuracy than state-of-the-art methods like GROBID and Crossref search. It also seems within the capacity of even the smallest model we tested (Qwen3-0.6B) to achieve high \verb|pass@1| accuracy with post-training through reinforcement learning. In this section, we conclude by discussing a few further directions for this research.
First, deploying these models will likely require specialized compute infrastructure, further model optimization, or both. Although, in this work, we tested non-quantized models on the latest GPUs, additional research is needed to evaluate accuracy and feasibility in the low-resource context that is typically available for academic journals.
Also, although the test in Section~\ref{sec:small-lm-distribution} shows that RLVR is likely to be effective for Qwen3-0.6B, sampled with reasoning, there are a variety of other training methods that could be used which are more able to shift the underlying distribution of a language model. In particular, distillation and supervised fine-tuning may be effective in learning a high-accuracy annotation system, especially because this problem has a lot of available training data.
Similarly, we did not explore any test-time techniques that could have improved accuracy or coverage. For instance, one can define a grammar and use constrained decoding to guarantee that the language model produces valid JATS XML, boosting coverage to 100\% \citep{Scholak2021PICARDPIA,poesia2022synchromeshreliablecodegeneration}. It has also been demonstrated that Best-of-N sampling, process supervision with reward models, and self-feedback can improve accuracy at inference time \citep{snell2024scalingllmtesttimecompute,madaan2023selfrefineiterativerefinementselffeedback}. Most of these techniques either require more compute or are not well optimized for existing inference frameworks so may not make sense for deployment.
One other limitation of our work is that it relies on an initial extraction phase where we used Llama-3.1-8B-Instruct to identify the plaintext list of citations. We did not test the accuracy of this step, but we did validate that all of the matched citations have high similarity. Another direction for future research is to evaluate extraction, which will be important for offline metadata enrichment.
Finally, it is worth returning to the significance of a tool which can efficiently and accurately parse the elements of a citation. Not only could this tool be deployed as part of journal software, but it could be applied offline to enrich the metadata for existing research publications. This new infrastructure could shed more light on how knowledge circulates in languages and contexts that have systematically excluded from the dominant research communities of the Global North.
\section{Funding}
This research was supported by free compute credits provided by \href{https://modal.com/}{Modal} and by the Social Sciences and Humanities Research Council of Canada (SSHRC) through Grant \#1007-2023-0001. The funder had no role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript.
The authors declare no conflicts of interest.
\newpage
\bibliography{iclr2024_conference}
\bibliographystyle{iclr2024_conference}
\newpage
\appendix
\section{Prompts}
\subsection{Citation extraction}\label{sec:citation-extraction}
\begin{tcolorbox}[title=System prompt for citation extraction]
You are an expert annotator that specializes in reading academic articles and isolating their bibliography. You will see the text of an academic article and you should write out a list of the references from the article bibliography, one on each line. Copy the references verbatim. Respond only with the list of references, no other text. Do not include bullet points or numbered lists, but edit the formatting so each citation fits on exactly one line. Do not include parenthetical citations. Just focus on the bibliography section.
\end{tcolorbox}
\subsection{Few-shot annotation}\label{sec:few-shot-prompts}
\begin{tcolorbox}[
title=No chain-of-thought system prompt,
enhanced,
breakable,
halign=left,
parbox=false, % <-- use normal paragraph layout
before upper={\setlength{\parskip}{6pt}}, % <-- 6 pt between paragraphs
skin first=enhanced,
skin middle=enhanced,
skin last=enhanced
]
You are a helpful assistant with an expertise in annotating bibliographic references in JATS XML format.
You will be given a plaintext citation and you should respond with the annotated reference. ONLY respond with the annotation and nothing else.
\# Examples
\#\#\# Citation
Stone NJ, Robinson JG, Lichtenstein AH, et al. 2013 ACC/AHA Guideline on the Treatment of Blood Cholesterol to Reduce Atherosclerotic Cardiovascular Risk in Adults: A Report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines. Circulation 2014;129(25 Suppl 2):S1-S45. doi:10.1161/01.cir.0000437738.63853.7a.
\#\#\# Annotation
<mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Stone</surname> <given-names>NJ</given-names></string-name>, <string-name><surname>Robinson</surname> <given-names>JG</given-names></string-name>, <string-name><surname>Lichtenstein</surname> <given-names>AH</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>2013 ACC/AHA Guideline on the Treatment of Blood Cholesterol to Reduce Atherosclerotic Cardiovascular Risk in Adults: A Report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines</article-title>. <source><italic>Circulation</italic></source> <year>2014</year>;<volume>129</volume>(<issue>25</issue> <supplement>Suppl 2</supplement>):<fpage>S1</fpage>-<lpage>S45</lpage>. <comment>doi</comment>:<pub-id pub-id-type="doi">10.1161/01.cir.0000437738.63853.7a</pub-id>.</mixed-citation>
\#\#\# Citation
Sagel Z, Tutluer Mİ, Peskircioglu H, et al.: Determination of Effect of Chemical Mutagen EMS on TAEK A-3 and TAEK C-10 Mutant Soybean Varieties in M1 Generation. Ekin Journal of Crop Breeding and Genetics. 2017; 3(1): 19–24. Reference Source
\#\#\# Annotation
<mixed-citation publication-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>Sagel</surname> <given-names>Z</given-names></name>, <name name-style="western"><surname>Tutluer</surname> <given-names>Mİ</given-names></name>, <name name-style="western"><surname>Peskircioglu</surname>, <given-names>H</given-names></name>, <etal /></person-group>:<article-title>Determination of Effect of Chemical Mutagen EMS on TAEK A-3 and TAEK C-10 Mutant Soybean Varieties in M<sub>1</sub> Generation.</article-title>. <source><italic toggle="yes">Ekin Journal of Crop Breeding and Genetics</italic></source>. <year>2017</year>;<volume>3</volume>(<issue>1</issue>): <fpage>19</fpage>–<lpage>24</lpage>. <ext-link>Reference Source</ext-link></mixed-citation>
\end{tcolorbox}
\begin{tcolorbox}[
title=Chain-of-thought system prompt,
enhanced,
breakable,
halign=left,
parbox=false, % <-- use normal paragraph layout
before upper={\setlength{\parskip}{6pt}}, % <-- 6 pt between paragraphs
skin first=enhanced,
skin middle=enhanced,
skin last=enhanced
]
You are a helpful assistant with an expertise in annotating bibliographic references in JATS XML format.
You will be given a plaintext citation and you should respond with the annotated reference. Before providing the final XML annotation, give your step-by-step thinking. After your explanation, provide the final XML annotation.
\# Examples
\#\#\# Citation
Stone NJ, Robinson JG, Lichtenstein AH, et al. 2013 ACC/AHA Guideline on the Treatment of Blood Cholesterol to Reduce Atherosclerotic Cardiovascular Risk in Adults: A Report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines. Circulation 2014;129(25 Suppl 2):S1-S45. doi:10.1161/01.cir.0000437738.63853.7a.
\#\#\# Annotation
<mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Stone</surname> <given-names>NJ</given-names></string-name>, <string-name><surname>Robinson</surname> <given-names>JG</given-names></string-name>, <string-name><surname>Lichtenstein</surname> <given-names>AH</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>2013 ACC/AHA Guideline on the Treatment of Blood Cholesterol to Reduce Atherosclerotic Cardiovascular Risk in Adults: A Report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines</article-title>. <source><italic>Circulation</italic></source> <year>2014</year>;<volume>129</volume>(<issue>25</issue> <supplement>Suppl 2</supplement>):<fpage>S1</fpage>-<lpage>S45</lpage>. <comment>doi</comment>:<pub-id pub-id-type="doi">10.1161/01.cir.0000437738.63853.7a</pub-id>.</mixed-citation>
\#\#\# Citation
Sagel Z, Tutluer Mİ, Peskircioglu H, et al.: Determination of Effect of Chemical Mutagen EMS on TAEK A-3 and TAEK C-10 Mutant Soybean Varieties in M1 Generation. Ekin Journal of Crop Breeding and Genetics. 2017; 3(1): 19–24. Reference Source
\#\#\# Annotation
<mixed-citation publication-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>Sagel</surname> <given-names>Z</given-names></name>, <name name-style="western"><surname>Tutluer</surname> <given-names>Mİ</given-names></name>, <name name-style="western"><surname>Peskircioglu</surname>, <given-names>H</given-names></name>, <etal /></person-group>:<article-title>Determination of Effect of Chemical Mutagen EMS on TAEK A-3 and TAEK C-10 Mutant Soybean Varieties in M<sub>1</sub> Generation.</article-title>. <source><italic toggle="yes">Ekin Journal of Crop Breeding and Genetics</italic></source>. <year>2017</year>;<volume>3</volume>(<issue>1</issue>): <fpage>19</fpage>–<lpage>24</lpage>. <ext-link>Reference Source</ext-link></mixed-citation>
\end{tcolorbox}
\newpage
\section{Energy consumption}\label{sec:energy-consumption}
NVIDIA lists the max thermal-design power (TDP) of the H200 chip to be up to \textbf{700W} \citep{nvidia_h200_2024}. Assuming that it was run at its full TDP for six hours, it would have used $0.7 \text{ kW} \times 6\text{ h} = 4.2 \text{ kWh}$ during its use. In 2024, the average power use effectiveness (PUE) for a U.S.-based center was $1.56$ \citep{uptime_survey_2024}. Assuming this PUE, we can estimate that our experiments actually required $4.2 \text{ kWh} \times 1.56 \approx \mathbf{6.6 \textbf{ kWh}}$.
The average carbon intensity for the U.S. power grid is estimated to be ${823.1}$ lb CO$_2$ per mWh \citep{epa_ghg_equivalencies_2024}. This is equivalent to $373.35$ kg CO$_2$ per mWH, or \textbf{$\mathbf{0.373}$ kg CO$\mathbf{_2}$ per kWh}.
Thus, we estimate the overall energy consumption of these experiments to be $6.6 \text{ kWh} \times 0.373\text{ kg CO$_2$/kWh} \approx \mathbf{2.46\textbf{ kg CO$_2$}}$.
According to the EPA, the average U.S. gasoline-powered passenger vehicle (including cars and trucks) emits $3.93 \times 10^{-4}$ metric tons CO$_2$ per mile, or $0.393$ kg CO$_2$ per mile \citep{epa_ghg_equivalencies_2024}. This means that the total emissions for our experiments are roughly equivalent to driving this vehicle \[ \frac{2.46 \text{ kg CO$_2$}}{0.393\text{ kg CO$_2$ per mile}} \approx \mathbf{6.26 \textbf{ miles}}. \]
\end{document}
%%%%% NEW MATH DEFINITIONS %%%%%
\usepackage{amsmath,amsfonts,bm}
% Mark sections of captions for referring to divisions of figures
\newcommand{\figleft}{{\em (Left)}}
\newcommand{\figcenter}{{\em (Center)}}
\newcommand{\figright}{{\em (Right)}}
\newcommand{\figtop}{{\em (Top)}}
\newcommand{\figbottom}{{\em (Bottom)}}
\newcommand{\captiona}{{\em (a)}}
\newcommand{\captionb}{{\em (b)}}
\newcommand{\captionc}{{\em (c)}}
\newcommand{\captiond}{{\em (d)}}
% Highlight a newly defined term
\newcommand{\newterm}[1]{{\bf #1}}
% Figure reference, lower-case.
\def\figref#1{figure~\ref{#1}}
% Figure reference, capital. For start of sentence
\def\Figref#1{Figure~\ref{#1}}
\def\twofigref#1#2{figures \ref{#1} and \ref{#2}}
\def\quadfigref#1#2#3#4{figures \ref{#1}, \ref{#2}, \ref{#3} and \ref{#4}}
% Section reference, lower-case.
\def\secref#1{section~\ref{#1}}
% Section reference, capital.
\def\Secref#1{Section~\ref{#1}}
% Reference to two sections.
\def\twosecrefs#1#2{sections \ref{#1} and \ref{#2}}
% Reference to three sections.
\def\secrefs#1#2#3{sections \ref{#1}, \ref{#2} and \ref{#3}}
% Reference to an equation, lower-case.
\def\eqref#1{equation~\ref{#1}}
% Reference to an equation, upper case
\def\Eqref#1{Equation~\ref{#1}}
% A raw reference to an equation---avoid using if possible
\def\plaineqref#1{\ref{#1}}
% Reference to a chapter, lower-case.
\def\chapref#1{chapter~\ref{#1}}
% Reference to an equation, upper case.
\def\Chapref#1{Chapter~\ref{#1}}
% Reference to a range of chapters
\def\rangechapref#1#2{chapters\ref{#1}--\ref{#2}}
% Reference to an algorithm, lower-case.
\def\algref#1{algorithm~\ref{#1}}
% Reference to an algorithm, upper case.
\def\Algref#1{Algorithm~\ref{#1}}
\def\twoalgref#1#2{algorithms \ref{#1} and \ref{#2}}
\def\Twoalgref#1#2{Algorithms \ref{#1} and \ref{#2}}
% Reference to a part, lower case
\def\partref#1{part~\ref{#1}}
% Reference to a part, upper case
\def\Partref#1{Part~\ref{#1}}
\def\twopartref#1#2{parts \ref{#1} and \ref{#2}}
\def\ceil#1{\lceil #1 \rceil}
\def\floor#1{\lfloor #1 \rfloor}
\def\1{\bm{1}}
\newcommand{\train}{\mathcal{D}}
\newcommand{\valid}{\mathcal{D_{\mathrm{valid}}}}
\newcommand{\test}{\mathcal{D_{\mathrm{test}}}}
\def\eps{{\epsilon}}
% Random variables
\def\reta{{\textnormal{$\eta$}}}
\def\ra{{\textnormal{a}}}
\def\rb{{\textnormal{b}}}
\def\rc{{\textnormal{c}}}
\def\rd{{\textnormal{d}}}
\def\re{{\textnormal{e}}}
\def\rf{{\textnormal{f}}}
\def\rg{{\textnormal{g}}}
\def\rh{{\textnormal{h}}}
\def\ri{{\textnormal{i}}}
\def\rj{{\textnormal{j}}}
\def\rk{{\textnormal{k}}}
\def\rl{{\textnormal{l}}}
% rm is already a command, just don't name any random variables m
\def\rn{{\textnormal{n}}}
\def\ro{{\textnormal{o}}}
\def\rp{{\textnormal{p}}}
\def\rq{{\textnormal{q}}}
\def\rr{{\textnormal{r}}}
\def\rs{{\textnormal{s}}}
\def\rt{{\textnormal{t}}}
\def\ru{{\textnormal{u}}}
\def\rv{{\textnormal{v}}}
\def\rw{{\textnormal{w}}}
\def\rx{{\textnormal{x}}}
\def\ry{{\textnormal{y}}}
\def\rz{{\textnormal{z}}}
% Random vectors
\def\rvepsilon{{\mathbf{\epsilon}}}
\def\rvtheta{{\mathbf{\theta}}}
\def\rva{{\mathbf{a}}}
\def\rvb{{\mathbf{b}}}
\def\rvc{{\mathbf{c}}}
\def\rvd{{\mathbf{d}}}
\def\rve{{\mathbf{e}}}
\def\rvf{{\mathbf{f}}}
\def\rvg{{\mathbf{g}}}
\def\rvh{{\mathbf{h}}}
\def\rvu{{\mathbf{i}}}
\def\rvj{{\mathbf{j}}}
\def\rvk{{\mathbf{k}}}
\def\rvl{{\mathbf{l}}}
\def\rvm{{\mathbf{m}}}
\def\rvn{{\mathbf{n}}}
\def\rvo{{\mathbf{o}}}
\def\rvp{{\mathbf{p}}}
\def\rvq{{\mathbf{q}}}
\def\rvr{{\mathbf{r}}}
\def\rvs{{\mathbf{s}}}
\def\rvt{{\mathbf{t}}}
\def\rvu{{\mathbf{u}}}
\def\rvv{{\mathbf{v}}}
\def\rvw{{\mathbf{w}}}
\def\rvx{{\mathbf{x}}}
\def\rvy{{\mathbf{y}}}
\def\rvz{{\mathbf{z}}}
% Elements of random vectors
\def\erva{{\textnormal{a}}}
\def\ervb{{\textnormal{b}}}
\def\ervc{{\textnormal{c}}}
\def\ervd{{\textnormal{d}}}
\def\erve{{\textnormal{e}}}
\def\ervf{{\textnormal{f}}}
\def\ervg{{\textnormal{g}}}
\def\ervh{{\textnormal{h}}}
\def\ervi{{\textnormal{i}}}
\def\ervj{{\textnormal{j}}}
\def\ervk{{\textnormal{k}}}
\def\ervl{{\textnormal{l}}}
\def\ervm{{\textnormal{m}}}
\def\ervn{{\textnormal{n}}}
\def\ervo{{\textnormal{o}}}
\def\ervp{{\textnormal{p}}}
\def\ervq{{\textnormal{q}}}
\def\ervr{{\textnormal{r}}}
\def\ervs{{\textnormal{s}}}
\def\ervt{{\textnormal{t}}}
\def\ervu{{\textnormal{u}}}
\def\ervv{{\textnormal{v}}}
\def\ervw{{\textnormal{w}}}
\def\ervx{{\textnormal{x}}}
\def\ervy{{\textnormal{y}}}
\def\ervz{{\textnormal{z}}}
% Random matrices
\def\rmA{{\mathbf{A}}}
\def\rmB{{\mathbf{B}}}
\def\rmC{{\mathbf{C}}}
\def\rmD{{\mathbf{D}}}
\def\rmE{{\mathbf{E}}}
\def\rmF{{\mathbf{F}}}
\def\rmG{{\mathbf{G}}}
\def\rmH{{\mathbf{H}}}
\def\rmI{{\mathbf{I}}}
\def\rmJ{{\mathbf{J}}}
\def\rmK{{\mathbf{K}}}
\def\rmL{{\mathbf{L}}}
\def\rmM{{\mathbf{M}}}
\def\rmN{{\mathbf{N}}}
\def\rmO{{\mathbf{O}}}
\def\rmP{{\mathbf{P}}}
\def\rmQ{{\mathbf{Q}}}
\def\rmR{{\mathbf{R}}}
\def\rmS{{\mathbf{S}}}
\def\rmT{{\mathbf{T}}}
\def\rmU{{\mathbf{U}}}
\def\rmV{{\mathbf{V}}}
\def\rmW{{\mathbf{W}}}
\def\rmX{{\mathbf{X}}}
\def\rmY{{\mathbf{Y}}}
\def\rmZ{{\mathbf{Z}}}
% Elements of random matrices
\def\ermA{{\textnormal{A}}}
\def\ermB{{\textnormal{B}}}
\def\ermC{{\textnormal{C}}}
\def\ermD{{\textnormal{D}}}
\def\ermE{{\textnormal{E}}}
\def\ermF{{\textnormal{F}}}
\def\ermG{{\textnormal{G}}}
\def\ermH{{\textnormal{H}}}
\def\ermI{{\textnormal{I}}}
\def\ermJ{{\textnormal{J}}}
\def\ermK{{\textnormal{K}}}
\def\ermL{{\textnormal{L}}}
\def\ermM{{\textnormal{M}}}
\def\ermN{{\textnormal{N}}}
\def\ermO{{\textnormal{O}}}
\def\ermP{{\textnormal{P}}}
\def\ermQ{{\textnormal{Q}}}
\def\ermR{{\textnormal{R}}}
\def\ermS{{\textnormal{S}}}
\def\ermT{{\textnormal{T}}}
\def\ermU{{\textnormal{U}}}
\def\ermV{{\textnormal{V}}}
\def\ermW{{\textnormal{W}}}
\def\ermX{{\textnormal{X}}}
\def\ermY{{\textnormal{Y}}}
\def\ermZ{{\textnormal{Z}}}
% Vectors
\def\vzero{{\bm{0}}}
\def\vone{{\bm{1}}}
\def\vmu{{\bm{\mu}}}
\def\vtheta{{\bm{\theta}}}
\def\va{{\bm{a}}}
\def\vb{{\bm{b}}}
\def\vc{{\bm{c}}}
\def\vd{{\bm{d}}}
\def\ve{{\bm{e}}}
\def\vf{{\bm{f}}}
\def\vg{{\bm{g}}}
\def\vh{{\bm{h}}}
\def\vi{{\bm{i}}}
\def\vj{{\bm{j}}}
\def\vk{{\bm{k}}}
\def\vl{{\bm{l}}}
\def\vm{{\bm{m}}}
\def\vn{{\bm{n}}}
\def\vo{{\bm{o}}}
\def\vp{{\bm{p}}}
\def\vq{{\bm{q}}}
\def\vr{{\bm{r}}}
\def\vs{{\bm{s}}}
\def\vt{{\bm{t}}}
\def\vu{{\bm{u}}}
\def\vv{{\bm{v}}}
\def\vw{{\bm{w}}}
\def\vx{{\bm{x}}}
\def\vy{{\bm{y}}}
\def\vz{{\bm{z}}}
% Elements of vectors
\def\evalpha{{\alpha}}
\def\evbeta{{\beta}}
\def\evepsilon{{\epsilon}}
\def\evlambda{{\lambda}}
\def\evomega{{\omega}}
\def\evmu{{\mu}}
\def\evpsi{{\psi}}
\def\evsigma{{\sigma}}
\def\evtheta{{\theta}}
\def\eva{{a}}
\def\evb{{b}}
\def\evc{{c}}
\def\evd{{d}}
\def\eve{{e}}
\def\evf{{f}}
\def\evg{{g}}
\def\evh{{h}}
\def\evi{{i}}
\def\evj{{j}}
\def\evk{{k}}
\def\evl{{l}}
\def\evm{{m}}
\def\evn{{n}}
\def\evo{{o}}
\def\evp{{p}}
\def\evq{{q}}
\def\evr{{r}}
\def\evs{{s}}
\def\evt{{t}}
\def\evu{{u}}
\def\evv{{v}}
\def\evw{{w}}
\def\evx{{x}}
\def\evy{{y}}
\def\evz{{z}}
% Matrix
\def\mA{{\bm{A}}}
\def\mB{{\bm{B}}}
\def\mC{{\bm{C}}}
\def\mD{{\bm{D}}}
\def\mE{{\bm{E}}}
\def\mF{{\bm{F}}}
\def\mG{{\bm{G}}}
\def\mH{{\bm{H}}}
\def\mI{{\bm{I}}}
\def\mJ{{\bm{J}}}
\def\mK{{\bm{K}}}
\def\mL{{\bm{L}}}
\def\mM{{\bm{M}}}
\def\mN{{\bm{N}}}
\def\mO{{\bm{O}}}
\def\mP{{\bm{P}}}
\def\mQ{{\bm{Q}}}
\def\mR{{\bm{R}}}
\def\mS{{\bm{S}}}
\def\mT{{\bm{T}}}
\def\mU{{\bm{U}}}
\def\mV{{\bm{V}}}
\def\mW{{\bm{W}}}
\def\mX{{\bm{X}}}
\def\mY{{\bm{Y}}}
\def\mZ{{\bm{Z}}}
\def\mBeta{{\bm{\beta}}}
\def\mPhi{{\bm{\Phi}}}
\def\mLambda{{\bm{\Lambda}}}
\def\mSigma{{\bm{\Sigma}}}
% Tensor
\DeclareMathAlphabet{\mathsfit}{\encodingdefault}{\sfdefault}{m}{sl}
\SetMathAlphabet{\mathsfit}{bold}{\encodingdefault}{\sfdefault}{bx}{n}
\newcommand{\tens}[1]{\bm{\mathsfit{#1}}}
\def\tA{{\tens{A}}}
\def\tB{{\tens{B}}}
\def\tC{{\tens{C}}}
\def\tD{{\tens{D}}}
\def\tE{{\tens{E}}}
\def\tF{{\tens{F}}}
\def\tG{{\tens{G}}}
\def\tH{{\tens{H}}}
\def\tI{{\tens{I}}}
\def\tJ{{\tens{J}}}
\def\tK{{\tens{K}}}
\def\tL{{\tens{L}}}
\def\tM{{\tens{M}}}
\def\tN{{\tens{N}}}
\def\tO{{\tens{O}}}
\def\tP{{\tens{P}}}
\def\tQ{{\tens{Q}}}
\def\tR{{\tens{R}}}
\def\tS{{\tens{S}}}
\def\tT{{\tens{T}}}
\def\tU{{\tens{U}}}
\def\tV{{\tens{V}}}
\def\tW{{\tens{W}}}
\def\tX{{\tens{X}}}
\def\tY{{\tens{Y}}}
\def\tZ{{\tens{Z}}}
% Graph
\def\gA{{\mathcal{A}}}
\def\gB{{\mathcal{B}}}
\def\gC{{\mathcal{C}}}
\def\gD{{\mathcal{D}}}
\def\gE{{\mathcal{E}}}
\def\gF{{\mathcal{F}}}
\def\gG{{\mathcal{G}}}
\def\gH{{\mathcal{H}}}
\def\gI{{\mathcal{I}}}
\def\gJ{{\mathcal{J}}}
\def\gK{{\mathcal{K}}}
\def\gL{{\mathcal{L}}}
\def\gM{{\mathcal{M}}}
\def\gN{{\mathcal{N}}}
\def\gO{{\mathcal{O}}}
\def\gP{{\mathcal{P}}}
\def\gQ{{\mathcal{Q}}}
\def\gR{{\mathcal{R}}}
\def\gS{{\mathcal{S}}}
\def\gT{{\mathcal{T}}}
\def\gU{{\mathcal{U}}}
\def\gV{{\mathcal{V}}}
\def\gW{{\mathcal{W}}}
\def\gX{{\mathcal{X}}}
\def\gY{{\mathcal{Y}}}
\def\gZ{{\mathcal{Z}}}
% Sets
\def\sA{{\mathbb{A}}}
\def\sB{{\mathbb{B}}}
\def\sC{{\mathbb{C}}}
\def\sD{{\mathbb{D}}}
% Don't use a set called E, because this would be the same as our symbol
% for expectation.
\def\sF{{\mathbb{F}}}
\def\sG{{\mathbb{G}}}
\def\sH{{\mathbb{H}}}
\def\sI{{\mathbb{I}}}
\def\sJ{{\mathbb{J}}}
\def\sK{{\mathbb{K}}}
\def\sL{{\mathbb{L}}}
\def\sM{{\mathbb{M}}}
\def\sN{{\mathbb{N}}}
\def\sO{{\mathbb{O}}}
\def\sP{{\mathbb{P}}}
\def\sQ{{\mathbb{Q}}}
\def\sR{{\mathbb{R}}}
\def\sS{{\mathbb{S}}}
\def\sT{{\mathbb{T}}}
\def\sU{{\mathbb{U}}}
\def\sV{{\mathbb{V}}}
\def\sW{{\mathbb{W}}}
\def\sX{{\mathbb{X}}}
\def\sY{{\mathbb{Y}}}
\def\sZ{{\mathbb{Z}}}
% Entries of a matrix
\def\emLambda{{\Lambda}}
\def\emA{{A}}
\def\emB{{B}}
\def\emC{{C}}
\def\emD{{D}}
\def\emE{{E}}
\def\emF{{F}}
\def\emG{{G}}
\def\emH{{H}}
\def\emI{{I}}
\def\emJ{{J}}
\def\emK{{K}}
\def\emL{{L}}
\def\emM{{M}}
\def\emN{{N}}
\def\emO{{O}}
\def\emP{{P}}
\def\emQ{{Q}}
\def\emR{{R}}
\def\emS{{S}}
\def\emT{{T}}
\def\emU{{U}}
\def\emV{{V}}
\def\emW{{W}}
\def\emX{{X}}
\def\emY{{Y}}
\def\emZ{{Z}}
\def\emSigma{{\Sigma}}
% entries of a tensor
% Same font as tensor, without \bm wrapper
\newcommand{\etens}[1]{\mathsfit{#1}}
\def\etLambda{{\etens{\Lambda}}}
\def\etA{{\etens{A}}}
\def\etB{{\etens{B}}}
\def\etC{{\etens{C}}}
\def\etD{{\etens{D}}}
\def\etE{{\etens{E}}}
\def\etF{{\etens{F}}}
\def\etG{{\etens{G}}}
\def\etH{{\etens{H}}}
\def\etI{{\etens{I}}}
\def\etJ{{\etens{J}}}
\def\etK{{\etens{K}}}
\def\etL{{\etens{L}}}
\def\etM{{\etens{M}}}
\def\etN{{\etens{N}}}
\def\etO{{\etens{O}}}
\def\etP{{\etens{P}}}
\def\etQ{{\etens{Q}}}
\def\etR{{\etens{R}}}
\def\etS{{\etens{S}}}
\def\etT{{\etens{T}}}
\def\etU{{\etens{U}}}
\def\etV{{\etens{V}}}
\def\etW{{\etens{W}}}
\def\etX{{\etens{X}}}
\def\etY{{\etens{Y}}}
\def\etZ{{\etens{Z}}}
% The true underlying data generating distribution
\newcommand{\pdata}{p_{\rm{data}}}
% The empirical distribution defined by the training set
\newcommand{\ptrain}{\hat{p}_{\rm{data}}}
\newcommand{\Ptrain}{\hat{P}_{\rm{data}}}
% The model distribution
\newcommand{\pmodel}{p_{\rm{model}}}
\newcommand{\Pmodel}{P_{\rm{model}}}
\newcommand{\ptildemodel}{\tilde{p}_{\rm{model}}}
% Stochastic autoencoder distributions
\newcommand{\pencode}{p_{\rm{encoder}}}
\newcommand{\pdecode}{p_{\rm{decoder}}}
\newcommand{\precons}{p_{\rm{reconstruct}}}
\newcommand{\laplace}{\mathrm{Laplace}} % Laplace distribution
\newcommand{\E}{\mathbb{E}}
\newcommand{\Ls}{\mathcal{L}}
\newcommand{\R}{\mathbb{R}}
\newcommand{\emp}{\tilde{p}}
\newcommand{\lr}{\alpha}
\newcommand{\reg}{\lambda}
\newcommand{\rect}{\mathrm{rectifier}}
\newcommand{\softmax}{\mathrm{softmax}}
\newcommand{\sigmoid}{\sigma}
\newcommand{\softplus}{\zeta}
\newcommand{\KL}{D_{\mathrm{KL}}}
\newcommand{\Var}{\mathrm{Var}}
\newcommand{\standarderror}{\mathrm{SE}}
\newcommand{\Cov}{\mathrm{Cov}}
% Wolfram Mathworld says $L^2$ is for function spaces and $\ell^2$ is for vectors
% But then they seem to use $L^2$ for vectors throughout the site, and so does
% wikipedia.
\newcommand{\normlzero}{L^0}
\newcommand{\normlone}{L^1}
\newcommand{\normltwo}{L^2}
\newcommand{\normlp}{L^p}
\newcommand{\normmax}{L^\infty}
\newcommand{\parents}{Pa} % See usage in notation.tex. Chosen to match Daphne's book.
\DeclareMathOperator*{\argmax}{arg\,max}
\DeclareMathOperator*{\argmin}{arg\,min}
\DeclareMathOperator{\sign}{sign}
\DeclareMathOperator{\Tr}{Tr}
\let\ab\allowbreak
\begin{thebibliography}{21}
\providecommand{\natexlab}[1]{#1}
\providecommand{\url}[1]{\texttt{#1}}
\expandafter\ifx\csname urlstyle\endcsname\relax
\providecommand{\doi}[1]{doi: #1}\else
\providecommand{\doi}{doi: \begingroup \urlstyle{rm}\Url}\fi
\bibitem[Alperin et~al.(2024)Alperin, Portenoy, Demes, Larivière, and Haustein]{alperin_analysis_2024}
Juan~Pablo Alperin, Jason Portenoy, Kyle Demes, Vincent Larivière, and Stefanie Haustein.
\newblock An analysis of the suitability of {OpenAlex} for bibliometric analyses.
\newblock \emph{arXiv preprint arXiv:2404.17663}, 2024.
\bibitem[Cetto et~al.(1998)Cetto, Alonso-Gamboa, Altbach, and Teferra]{cetto_scientific_1998}
Ana~Marıa Cetto, Octavio Alonso-Gamboa, PG~Altbach, and D~Teferra.
\newblock Scientific and scholarly journals in {Latin} {America} and the {Caribbean}.
\newblock \emph{Knowledge dissemination in Africa: The role of the scholarly journal, ed. Philip G. Altbach and Damtew Teferra}, pp.\ 99--126, 1998.
\bibitem[Choi et~al.(2023)Choi, Yoon, Hyun, Lee, Seol, Lee, Yoon, and Kong]{Choi2023BuildingAA}
Wonjun Choi, Hwamook Yoon, Mihwan Hyun, Hyejin Lee, Jaewook Seol, Kangsan~Dajeong Lee, Young~Joon Yoon, and Hyesoo Kong.
\newblock Building an annotated corpus for automatic metadata extraction from multilingual journal article references.
\newblock \emph{PLOS ONE}, 18, 2023.
\newblock URL \url{https://api.semanticscholar.org/CorpusID:256031950}.
\bibitem[Culbert et~al.(2024)Culbert, Hobert, Jahn, Haupka, Schmidt, Donner, and Mayr]{culbert_reference_2024}
Jack Culbert, Anne Hobert, Najko Jahn, Nick Haupka, Marion Schmidt, Paul Donner, and Philipp Mayr.
\newblock Reference coverage analysis of openalex compared to web of science and {Scopus}.
\newblock \emph{arXiv preprint arXiv:2401.16359}, 2024.
\bibitem[Donnellan et~al.(2024)Donnellan, Lawrence, Bizo, et~al.]{uptime_survey_2024}
Douglas Donnellan, Andy Lawrence, Daniel Bizo, et~al.
\newblock {Uptime Institute Global Data Center Survey 2024}, jul 2024.
\newblock URL \url{https://datacenter.uptimeinstitute.com/rs/711-RIA-145/images/2024.GlobalDataCenterSurvey.Report.pdf}.
\bibitem[{European Commission}(2025)]{openresearcheurope_corpus_2025}
{European Commission}.
\newblock {Open Research Europe}: Full article corpus.
\newblock \url{https://open-research-europe.ec.europa.eu}, 2025.
\newblock Complete collection of all articles published on Open Research Europe; accessed 19 March 2025.
\bibitem[Garnett(2016)]{garnett_xml_2016}
Alex Garnett.
\newblock The {XML} {Markup} {Evaluation} {Corpus}, April 2016.
\newblock URL \url{https://pkp.sfu.ca/2016/04/18/the-xml-markup-evaluation-corpus/}.
\bibitem[Gray \& Suri(2019)Gray and Suri]{gray2019ghost}
Mary~L Gray and Siddharth Suri.
\newblock \emph{{Ghost work: How to stop Silicon Valley from building a new global underclass}}.
\newblock Harper Business, 2019.
\bibitem[Hao(2024)]{hao2024ai}
Karen Hao.
\newblock Ai is taking water from the desert.
\newblock \emph{The Atlantic}, March 2024.
\newblock URL \url{https://www.theatlantic.com/technology/archive/2024/03/ai-water-climate-microsoft/677602/}.
\bibitem[Jiao et~al.(2023)Jiao, Li, and Fang]{jiao_how_2023}
Chenyue Jiao, Kai Li, and Zhichao Fang.
\newblock How are exclusively data journals indexed in major scholarly databases? {An} examination of four databases.
\newblock \emph{Scientific Data}, 10\penalty0 (1):\penalty0 737, 2023.
\newblock Publisher: Nature Publishing Group UK London.
\bibitem[Joshi et~al.(2023)Joshi, Symeonidou, Danish, and Hermsen]{Joshi2023AnEP}
Bikash Joshi, Anthi Symeonidou, Syed~Mazin Danish, and Floris Hermsen.
\newblock An end-to-end pipeline for bibliography extraction from scientific articles.
\newblock \emph{Proceedings of the Second Workshop on Information Extraction from Scientific Publications}, 2023.
\newblock URL \url{https://api.semanticscholar.org/CorpusID:267406919}.
\bibitem[Khanna et~al.(2022)Khanna, Ball, Alperin, and Willinsky]{khanna_recalibrating_2022}
Saurabh Khanna, Jon Ball, Juan~Pablo Alperin, and John Willinsky.
\newblock Recalibrating the scope of scholarly publishing: {A} modest step in a vast decolonization process.
\newblock \emph{Quantitative Science Studies}, 3\penalty0 (4):\penalty0 912--930, 2022.
\newblock Publisher: MIT Press One Broadway, 12th Floor, Cambridge, Massachusetts 02142, USA.
\bibitem[Madaan et~al.(2023)Madaan, Tandon, Gupta, Hallinan, Gao, Wiegreffe, Alon, Dziri, Prabhumoye, Yang, Gupta, Majumder, Hermann, Welleck, Yazdanbakhsh, and Clark]{madaan2023selfrefineiterativerefinementselffeedback}
Aman Madaan, Niket Tandon, Prakhar Gupta, Skyler Hallinan, Luyu Gao, Sarah Wiegreffe, Uri Alon, Nouha Dziri, Shrimai Prabhumoye, Yiming Yang, Shashank Gupta, Bodhisattwa~Prasad Majumder, Katherine Hermann, Sean Welleck, Amir Yazdanbakhsh, and Peter Clark.
\newblock {Self-Refine: Iterative Refinement with Self-Feedback}, 2023.
\newblock URL \url{https://arxiv.org/abs/2303.17651}.
\bibitem[{Microsoft Corporation}(2025)]{markitdown2025}
{Microsoft Corporation}.
\newblock \emph{{MarkItDown: A Python Tool for Converting Files to Markdown}}, 2025.
\newblock URL \url{https://github.com/microsoft/markitdown}.
\newblock Version 0.1.1.
\bibitem[Mongeon \& Paul-Hus(2016)Mongeon and Paul-Hus]{mongeon_journal_2016}
Philippe Mongeon and Adèle Paul-Hus.
\newblock The journal coverage of {Web} of {Science} and {Scopus}: a comparative analysis.
\newblock \emph{Scientometrics}, 106:\penalty0 213--228, 2016.
\newblock Publisher: Springer.
\bibitem[{NVIDIA Corporation}(2024)]{nvidia_h200_2024}
{NVIDIA Corporation}.
\newblock {NVIDIA H200 Tensor Core GPU Datasheet}.
\newblock Technical report, NVIDIA Corporation, jul 2024.
\newblock URL \url{https://www.megware.com/fileadmin/user_upload/LandingPage%20NVIDIA/NVIDIA_H200_Datasheet.pdf}.
\newblock Preliminary specifications.
\bibitem[Poesia et~al.(2022)Poesia, Polozov, Le, Tiwari, Soares, Meek, and Gulwani]{poesia2022synchromeshreliablecodegeneration}
Gabriel Poesia, Oleksandr Polozov, Vu~Le, Ashish Tiwari, Gustavo Soares, Christopher Meek, and Sumit Gulwani.
\newblock {Synchromesh: Reliable code generation from pre-trained language models}, 2022.
\newblock URL \url{https://arxiv.org/abs/2201.11227}.
\bibitem[Scholak et~al.(2021)Scholak, Schucher, and Bahdanau]{Scholak2021PICARDPIA}
Torsten Scholak, Nathan Schucher, and Dzmitry Bahdanau.
\newblock {PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Models}.
\newblock \emph{ArXiv}, abs/2109.05093, 2021.
\newblock URL \url{https://www.aclanthology.org/2021.emnlp-main.779.pdf}.
\bibitem[Snell et~al.(2024)Snell, Lee, Xu, and Kumar]{snell2024scalingllmtesttimecompute}
Charlie Snell, Jaehoon Lee, Kelvin Xu, and Aviral Kumar.
\newblock {Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters}, 2024.
\newblock URL \url{https://arxiv.org/abs/2408.03314}.
\bibitem[{U.S. Environmental Protection Agency}(2024)]{epa_ghg_equivalencies_2024}
{U.S. Environmental Protection Agency}.
\newblock {Greenhouse Gas Equivalencies Calculator – Calculations and References}.
\newblock \url{https://www.epa.gov/energy/greenhouse-gas-equivalencies-calculator-calculations-and-references}, 2024.
\newblock Accessed: 2025-05-20.
\bibitem[Yue et~al.(2025)Yue, Chen, Lu, Zhao, Wang, Yue, Song, and Huang]{yue2025doesreinforcementlearningreally}
Yang Yue, Zhiqi Chen, Rui Lu, Andrew Zhao, Zhaokai Wang, Yang Yue, Shiji Song, and Gao Huang.
\newblock {Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?}, 2025.
\newblock URL \url{https://arxiv.org/abs/2504.13837}.
\end{thebibliography}