Integration of Large Language Models and Traditional Deep Learning for Social Determinants of Health Prediction

Extracted source text · arXiv 2505.04655

\newif\ifisfinal\isfinaltrue
\documentclass[10pt,twocolumn]{article}


%% Imports
%
%\usepackage[headings]{fullpage}
\usepackage[init=true]{sdoh}
\usepackage{zlhref}
\usepackage{zlsec}
\usepackage{zlfig}
\usepackage{zllist}
\usepackage{zltable}
\usepackage[
  bibname=sdoh,
  biboptions={natbib=true,backend=biber,hyperref=true,style=nature},
  superscript=true
]{zvgenmed}


%% Paper configuration
%
% margins
\usepackage[margin=2.5cm]{geometry}

% initialize the pub template
\zaveninit%

% authors
\zeauthors%


%% Format
%
% font
\usepackage[T1]{fontenc}
\usepackage[scaled=.95]{helvet}
\renewcommand{\familydefault}{\sfdefault}

% this paper's tables' size
\zttabvarsize[\tabsize]{.85}

% auth/inst space
%\setlength{\affilsep}{.5em}

% span abstract across both columns
\usepackage{widetext}
\setlength{\wttlinewidth}{0.0pt}
\renewenvironment{abstract}{%
  \begin{widetext}
    \vspace{-1.6cm}
    \centering
    \begin{minipage}{0.85\textwidth}
      \centerline{\textbf{\abstractname}} \small}{%
    \end{minipage}
  \end{widetext}}


% less hyphenation
\hyphenpenalty=1000

% figures and tables can float to page bottoms
\usepackage{dblfloatfix}


%% Document
%
\begin{document}
\zavenbegindoc%
\input{sections/intro} % includes abstract
\input{sections/results}
\input{sections/discuss}
\input{sections/methods}
\input{sections/eval-avail}


%\clearpage
\zavenenddoc%

\clearpage
\onecolumn
\zavenappendix%

\zsapx[few-shot-prompt]{Few-shot Prompt}
\input{apx/few-shot-prompt}

\zsapx[train-prompt]{Training Prompt}
\input{apx/train-prompt}


\end{document}

\begin{abstract}

  \sdoh\ are economic, social and personal circumstances that affect or influence an individual's health status.  \sdohs\ have shown to be correlated to wellness outcomes, and therefore, are useful to physicians in diagnosing diseases and in decision-making.  In this work, we automatically extract \sdohs\ from clinical text using traditional deep learning and \llms\ to find the advantages and disadvantages of each on an existing publicly available dataset.
  %
  Our models outperform a previous reference point on a multilabel \sdoh\ classification by \diffGue\ points, and we present a method and model to drastically speed up classification (\twoStepSpeedUp{}X execution time) by eliminating expensive \llm\ processing.  The method we present combines a more nimble and efficient solution that leverages the power of the \llm\ for precision and traditional deep learning methods for efficiency.  We also show highly performant results on a dataset supplemented with synthetic data and several traditional deep learning models that outperform \llms.  Our models and methods offer the next iteration of automatic prediction of \sdohs\ that impact at-risk patients.

\end{abstract}

\acresetall % reset the "memory" of acro


\zssec[intro]{Introduction}

\sdoh\ greatly affect health, well-being and quality of life.  Safe housing, job opportunities, discrimination, and environmental factors are just a few examples \sdoh\ types.  Adverse \sdohs\ have immediate and profound affects on patient's health, such as air quality's negative affect on one's respiratory system or access to healthcare for those without income stability.  The impact of \sdohs\ on health outcomes have been shown to be helpful in prediction of diabetes mellitus~\cite{hill-briggsSocialDeterminantsHealth2021}, recurring diabetic keto-acidosis\cite{lyerlaRecurrentDKAResults2021}, and prolonged hospital stays~\cite{keenanSocialFactorsAssociated2002}.

Although \ehr\ systems have incorporated \sdohs\ as structured data, many systems have not, or represent the data with highly varying formats~\cite{liRealizingPotentialSocial2024,wangDocumentationReviewSocial2021,goldAdoptionSocialDeterminants2018}.  To address these challenges, many have turned \nlp\ methods to automatically extract \sdohs\ from clinical text.  The current \ac{sota} for this type of extraction incorporates \llms\ in either a few-shot learning or supervised-fine tuning setting~\cite{guevaraLargeLanguageModels2024,lituievAutomaticExtractionSocial2023}.

\summaryResultTab[t]{\tabsize} % table: Multilabel model performance by average

\byLabelResultTab[b]{\tabsize} % table: Multilabel model performance by label

We build on the work of \getal\ by training a variety of similar models on their publicly released datasets\footnote{We can not compare directly as \getal\ did not release their model, training dataset or prompts. In their work, the \mimicname\ and synthetic datasets were used for testing only.}  \ztsee{datasetStatsTab}.  The first dataset is subset of the \mimic\ corpus\cite{\mimicct}, \mimicdef.  This dataset consists of 5,355 sentences taken from \mimic\ clinical notes that were annotated for zero or more \sdohs.  A synthetic dataset generated from \llms\ was also released, containing one or more \sdohs, with 588 sentences annotated with at least one \sdoh.  The synthetic dataset was intended to provide a larger training set to boost results on the test dataset (\mimic).

Our experiments test Llama models~\cite{\llamact} for multilabel classification, and encoder-only \bert~\cite{\bertct} models for both multilabel and binary classification.  We experiment with several feature combinations in our traditional models and our \llm\ models with few-shot and supervised fine-tuning settings.  After error and performance analysis, we integrated both \llms\ and traditional deep learning \nlp\ models to exploit the best of both worlds.

Our binary traditional deep learning models performed inference up to \twoBinaryToLlamaSpeedup\ times faster than our slowest \llm\ \ztsee{resultLatencyTab}.  Based on this observation, we adopted a new \twostep\ model that predicts sentences with at least one \sdoh.  For those that do, we use the predictive power of Llama for multilabel classification.  The models were evaluated with a 10-fold cross-validation and with train, test and validation splits.

As small syntax changes can increase the variability of the generated text~\cite{wangSelfConsistencyImprovesChain2022}, we release our prompts for reproducibility (see \zsapxref{few-shot-prompt} and \zsapxref{train-prompt}).  We also release our data splits with ordering and our source code \zsseesec{data-avail}.  Next, we report on the results of all the classifiers, the performant \twostep\ classifier and the surprisingly positive effects of the synthetic dataset.

\zssec{Results}

We compare our results to \getal, but only as a reference point and not as test-only datasets.  We show that the our \twostep\ classifier is \diffGueTwoStep\ macro F1 points more performant than the reference point baseline \ztsee{summaryResultTab} and \twoStepSpeedUp{} times faster than the smallest \llm\ \ztsee{resultLatencyTab}.  Furthermore, our models show improvement with the synthetic data added to the \mimic\ data (we call this the \mimthetic\ dataset) compared to previous work, which shows a decrease in performance~\cite{\sdohidct}.


\zssubsec[model-perf]{Multilabel classifier}

\ztRef{summaryResultTab} gives the performance metric averages and \ztref{byLabelResultTab} gives performance metrics by labels on the \mimic\ and \mimthetic\ datasets.  The highest performing model by macro F1 (\bestAveMimicMacro) is the \bestAveMimicModel\ model.  The traditional deep learning encoder-only \textit{RoBERTa Base} model shows the best weighted average F1 on the \mimic-only dataset but falls behind all fine-tuned \llms.  The traditional model trails \diffLamSmall\ points behind the \llamaeight\ model and \diffGueTrad\ points behind the \getal\ baseline reference (\gueMFScore).

\ztRef{multiCrossFoldMimicStatsTab} shows the results of the 10-fold cross-validation of the traditional deep learning multilabel classifier on the \mimthetic\ dataset.  The weighted F1 score (\mlMimtheticCvMeanWeightedFScore) is stable, but the macro F1 score (\mlMimtheticCvMeanMacroFScore) is relatively low comparatively.  This statistic is illuminating as the classifier performs better by random variation on the test split (\bestAveMimtheticMacro\ in \ztref{summaryResultTab}).

\multiCrossFoldMimicStatsTab[t]{\tabsize}


\zssubsec[binary]{Binary classifier}

The label results from the best performing binary classifier taken from the ablation study is given in \ztref{binByLabelResultsTab}.  It has a lower performance with the minority label (sentences having at least one \sdoh).  However, a 10-fold cross validation with \cvrepeats\ repeats yields an average macro F1 of \binaryMimicCvMeanMacroFScore\ \ztsee{binCrossFoldMimicStatsTab}.  The results show a high confidence of this statistic with a standard deviation just over a half a point across all 50 tests.

\binByLabelResultsTab{\tabsize} % table: Multilabel model performance by label

\binCrossFoldMimicStatsTab[t]{\tabsize}


\zssubsec[tsres]{\Twostep\ classifier}

The \twostep\ classifier performs within a weighted F1 point of the best model (traditional deep learning \roberta) and within 5 points of the best macro F1 score (\llamaeight) as shown in \ztref{summaryResultTab}.  The classifier uses the traditional deep learning model for the negative label (\nosdoh), and the recall is significantly lower macro recall compared to precision, shows it struggles with false negatives at the binary level.  This is also reflected in the comparatively low macro recall from the cross-validated results in \ztref{multiCrossFoldMimicStatsTab}.

\zfaddtc[t][]{binary-ablation}[Traditional model ablations]{The multilabel and binary model feature ablations by macro F1 performance are shown for the \mimic\ and \mimthetic\ validation sets.  The triangles represent the best performing macro F1 on the training set (also listed in the legend) and converged epochs on the X-axis.  Features are \scol{P}{art}-\scol{O}{of}-\scol{S}{each} tag, \scol{Dep}{endency} head tree depth, named \scol{Ent}{ity}, \scol{Med}{ical} named \scol{Ent}{ity}, \scol{Cui Emb}{bedding} and \scol{Tok}{en-level}\scol{SDoH}{}.}


\zssubsec[err]{Error analysis}

Our traditional deep learning multilabel classifiers failed for labels \texttt{Housing} and \texttt{Transportation} on the \mimic\ dataset.  These labels have only three occurrences each \ztsee{mimicCorpusTab}.  The \twostep\ classifier gets the single \texttt{Housing} instance correct, which means the binary traditional classifier learned that it was \sdoh\ positive and the \llm\ correctly classified it but still failed on the \texttt{Transportation} label.  However, all of our \llms\ achieved a non-zero score on all labels and outperformed the \getal\ reference models for most labels.  Furthermore, our models perform better on every label on the \mimthetic\ dataset.

The method of parsing of the \llm\ output might negatively affect performance.  A complex regular expression was needed to parse the noisy \llm\ output.  Models hallucinated in the few-shot setting (output on the \mimic\ dataset was more noisy than on the \mimthetic), but were more consistent on the fine-tuned models.  Of course, this was not an issue for the traditional deep learning model as its output layer directly predicted each label.  However, coupling traditional models with \llms\ can have consequences, such as with the \twostep\ classifier.

The \twostep\ classifier uses the binary classifier to predict if a \sdoh\ is present in a sentence.  When it predicts the presence of one or more \sdohs, it uses the \llamaeight\ model to assign labels.  As noted in \zssecref{tsres}, the binary classifier has a lower recall than precision, but the \llamaeight\ model's recall is significantly higher \ztref{summaryResultTab}.  This could be propagation error from false negative \sdoh\ classifications.  However, \ztref{multiCrossFoldMimicStatsTab} shows a very similar macro precision and recall, so the \llm\ might not assign any labels since the classifier was trained with \nosdoh\ as a label.  The \twostep\ classifier may perform better using a \llm\ trained without negative \sdoh\ labels.


\zssubsec[ablation]{Ablation studies}

Our ablation studies include feature combinations on the traditional deep learning binary classifier.  Each feature combination is a model that learns jointly with the \roberta\ embeddings \zsseesec{nn}.  \zfRef{binary-ablation} shows the ablation of the features as macro average F1 performance over epochs of training the models on the validation set.  The performance for the feature combination on the test set are displayed with triangles and in parentheses in the legend.

We see very high variance of the multilabel feature combinations' test set scores across model type.  Part-of-speech tags, head dependency features, and named entities were the most useful on the \mimic\ dataset but the \letal\ token-level \sdoh\ feature was the most helpful for the \mimthetic\ dataset.

The binary models on the \mimthetic\ dataset are much less sensitive to the choice of feature set implying the \roberta\ embeddings are leveraged to take advantage of the added synthetic data.  Adding features appears to negatively affect models on the \mimic\ dataset for some combinations.  The binary model illustrates how adding features may lead to worse performance.  The feature combination that includes all features performs five points lower on the \mimic\ dataset compared to the \mimthetic\ dataset.

\zssec[discuss]{Discussion}

As shown in \ztref{summaryResultTab}, our fine-tuned \llamaeight\ classifier shows a significant improvement over the \getal\ reference baseline on the \mimic\ dataset.  Our \llm\ performance metrics were based on a 20\% held-out test set across the \mimic\ and \mimthetic\ datasets whereas \getal\ use the annotated \mimic\ data as a test set.

The \llm\ models perform better on the \mimthetic\ dataset over the \mimic\ dataset as seen in \ztref{summaryResultTab} and \ztref{binCrossFoldMimicStatsTab}, which demonstrates that the models learn from the synthetic data.  The \mimic\ dataset's leader model was the \llamaeight.  However, the traditional deep learning models were not far behind on the \mimthetic\ dataset suggesting that the \llms\ models better adapt to the smaller dataset.

The traditional deep learning multilabel model was trained using the same features as the binary model described in the \zssecref{ablation}.  As explained in \zssecref{model-perf}, the multilabel classifier performs well overall, but very poorly on the minority labels.  The classifier under-performed on our \llms\ by 14 macro F1 points, but outperformed all \llms\ in the weighted F1.

As mentioned in \zssecref{err}, it is clear the traditional multilabel model has difficulty with the label imbalance given it fails in predicting the \texttt{Housing} and \texttt{Transportation} labels as shown in \ztref{byLabelResultTab}.  This result pales in comparison to the fine-tuned \llms\ that have a non-zero performance with all labels.

Furthermore, we observe the traditional model's ability at detecting \sdohs\ with a higher macro recall (0.49) than precision (0.6).  However, the converse is true with all \llms\ on the \mimic\ dataset (this dataset includes sentences with no \sdoh).  These observations motivate a binary classifier that predicts whether a sentence has any \sdoh\ \zsseesec{discuss}.  The high weighted F1 and recall metrics motivated the \twostep\ model.


\zssubsec{Inference latency}

The models differ greatly in inference latencies, particularly between the traditional models and \llms.  Pipeline processing bottlenecks arise as the latency of a classifier grows with the large input size of input, such as with longitudinal notes.

Our binary classifier performs as well as the best \getal\ model on the \mimic\ dataset.  However, it inferences at a fraction of the time of the \llms\ as the model is a fraction of the size.  The traditional binary classifier is able to predict up to \binSentPerSec\ sentences per second on average compared to the fastest \llm\ that predicts \fastestLlmSentPerSec\ sentences per second \ztsee{resultLatencyTab}.  The \twostep\ classifier is not far behind with speed up of \twoBinaryToLlamaSpeedup{}X, which translates to a prediction rate of \twoStepSentPerSec\ sentences per second.

\resultLatencyTab[t]{\tabsize}


\zssubsec{\Twostep\ and binary classifiers}

The binary classifier achieved a F1 of \binaryMimicCvMeanMacroFScore\ on our test split of the \mimic\ dataset.  The stratified dataset contains 992 negative \sdoh\ labels and 73 positive labels.  This dataset imbalance explains the lower F1 score of 0.767 on the positive labels.  However, it is \twoBinaryToLlamaSpeedup{} times faster compared to the \llamaeight\ fine-tuned model.

Our experiments show that the binary classifier used as the first component in the \twostep\ classifier is relatively close in performance to the fine-tuned \llms.  The \twostep\ classifier yields a macro F1 of \twoStepMimicMacro, which is only two macro F1 points lower than the \llamasev\ model \ztsee{summaryResultTab}.  Considering the \twostep\ classifier is \twoStepSpeedUp{} times faster than the \llamaeight\ classifier, we believe it shows the best performance trade off for real-world clinical application.

\datasetStatsTab[b]{\tabsize}

\zssec[method]{Methods}

We elaborated on the models by \getal\ using their datasets.  We also added a new model (\twostep) that integrates both the traditional deep learning binary model for efficiency and a \llm\ for precision.


\zssubsec[data]{Data}

\mimicCorpusTab[t]{\tabsize}

\mimtheticCorpusTab[t]{\tabsize}

The \getal\ publicly available \mimic\ and synthetic datasets were used for all experiments \zsseesec{data-avail}.  We also combined these two datasets, which we call the \mimthetic\ dataset.  Each data point in the datasets is a sentence and the associated \sdoh\ labels.  The labels apply to sentences rather than tokens.

We split both the \mimic\ and \mimthetic\ datasets each using a multilabel iterative stratification~\cite{sechidisStratificationMultilabelData2011} \zhfooturl{library}{https://github.com/trent-b/iterative-stratification} across \sdoh\ classes.  \ztRef{datasetStatsTab} shows our splits on each dataset with splits by label for the \mimic\ dataset in \ztref{mimicCorpusTab} and the \mimthetic\ label splits in \ztref{mimtheticCorpusTab}.


\zssubsec[model]{Model development}

We trained two types of models: binary (determines if a \sdoh\ exists) and a multilabel that classified zero or more \sdohs.  These models included:
\begin{itemize}
\item Supervised-fine tuned \llm: classifies zero or more \sdoh\ labels
\item Traditional deep learning multilabel: classifies zero or more \sdoh\ labels
\item Traditional deep learning binary: predicts whether a sentence has at least one \sdoh
\item \Twostep\ that integrates the traditional binary classifier with a \llm
\end{itemize}

The traditional deep learning and LLM models were trained and developed on the same dataset.


\zssubsec[model:llm]{Large language models}

The \llamaeight\ and \llamasev~~\cite{\llamact} models were used for all \llm\ experiments.  We used the \getal\ \anonguide\ to engineer our prompts for two settings: few-shot (\zsapxref{few-shot-prompt}) and supervised-fine tuned (\zsapxref{train-prompt}).

The few-shot prompts included the entire definition of each \sdoh\ category from the annotation guide.  The few-shot prompts also included examples of each of the six categories with a simple explanation of the special label (\nosdoh) for missing \sdohs.  The supervised fine-tuned training prompts included one or two sentence synopsis from the annotation guide for each category.  All fine-tuned \llms\ were trained using \lora~(\acl{lora})~\cite{\loract} with a rank of 64, a learning rate of $5 \times 10^{-5}$, and dropout of 10\% for three epochs.

Our experiments included feature prompt injection~\cite{kanayamaIncorporatingSyntaxLexical2024} in both few-shot and supervised fine-tuned settings using the token-level \sdoh\ feature~\cite{lituievAutomaticExtractionSocial2023} and the \cui's preferred name \zsseesec{cui-feature}.  However, only the few-shot setting marginally improved, so the results are not reported.


\zssubsec[model:trad]{Traditional deep learning models}

All traditional deep learning models were trained for 40 epochs, but the model with the lowest validation loss was used for evaluation.  The multilabel classifier was trained with a learning rate of $1 \times 10^{-5}$ and the binary classifier with a learning rate of $6.5 \times 10^{-6}$.


\zssubsubsec[feature-eng]{Feature engineering}

The traditional deep learning models incorporated several combinations of features.  The \roberta~\cite{\robertact} base model transformer was used and enhanced to accommodate token-level features \zsseesec{nn}.  These included linguistic features were extracted from tokenized text using \spacyname~\cite{\spacyct} and biomedical entities extracted with \scispacyname~\cite{\scispacyct}.  The \zeciteshort{lituievAutomaticExtractionSocial2023} model was used to add the prediction as the \sdoh\ token feature.

These features were concatenated to the transformer's final layer output for fine-tuning.  One influential feature was an encoded medical concept extracted from the input sentences \zsseesec{cui-feature}.  A list of features and their descriptions are given in \ztref{featureDescTab}.

\featureDescTab[b]{\tabsize} % table: feature descriptions


\zssubsubsec[cui-feature]{Concept features}

% remind reader and redefine (if we haven't already)
\acreset{umls}\acreset{cui}

The \umls\ is \umlsdef~\cite{\umlsct}.  Each node in the \umls\ graph represents a \cui.  Each \cui\ has many properties, two of which are the \textit{preferred name} (a common name for the concept) and a \textit{definition} of the concept, which can be exploited to provide more context to the model for each token.

We considered two methods creating additional features using \cuis\ found in the clinical text.  The first was simply to use embeddings generated from the \cui's preferred name and definition.  We also considered adding \cuitovec~\cite{\cuitovecct} embeddings, which are 500D vectors trained from clinical text using the \wtv\ algorithm~\cite{\wtvct}.  However, \cuitovec\ feature sparsity was a concern as its vocabulary is a subset of \umls, which is then further conditioned by a less than perfect recall by the entity linker.

\zfadd[t][0.85\columnwidth]{cui-occurrences}[\cui\ distribution]{Occurrences of \mimic\ dataset sentences with extracted concept identifiers and available mapped \cuitovec.  Each bar is the per sentence count (\zeie\ the 0-bar is the number of sentences with 0 \cuis\ extracted).}

\zfaddtc[][0.75\textwidth]{trad-model}[Traditional multilabel model]{An example of a sentence processed through the traditional multilabel model.  The clinical text input is encoded by a \roberta, an entity linker and several linguistic taggers.  Each of these components' output is concatenated, passed through a 1D \ac{cnn} and decoded as zero or more labels.}

To make an informed decision, we computed a \cui\ and \cuitovec\ in-vocabulary distributions from the \mimic\ dataset.  \cuis\ were extracted using The \medcat~\cite{\medcatct} entity linker and were then assigned a numerical count per sentence.  As shown in the first bar in \zfref{cui-occurrences}, the number of sentences with no \cui\ is 3,434 (65\% of the dataset) and the \cuitovec\ embeddings available for those are even more scarce.  However, given that 1,887 sentences (35\% of the dataset) were found to have at least one \cui, we opted for a middle-ground solution to encode the \cui\ properties and leave the implementation of the \cuitovec\ features for future work.

To encode of the \cui\ properties, a \acl{sbert} (\sbert) model~\cite{\sbertct} was used to create embeddings.  We give the model a way to relate from medical concepts to \sdohs\ semantically as \sbert\ models embed text in Euclidean space.  Embedding the \cui\ with \roberta\ would add little or add redundancy in cases where the properties are close or identical to the text.

A clinically trained \sbert\ model~\cite{dekaImprovedMethodsAid2022} was used for the \cui{}s' embedding.  Only the static embeddings from a forward inference were used due to memory constraints of fine-tuning two (the \sbert\ and \roberta) models in parallel.  Text in the form \texttt{<preferred name>:<definition>} was used as input to the \sbert\ model and repeated (stacked) the embeddings across all \wpts~\cite{\wptct} (\wptdef) tagged by the entity linker for each concept.  Next, we explain how \cuis\ are vectorized and used with examples.


\zssubsubsec[nn]{Neural architecture}

The traditional deep learning multilabel and binary models use the same neural network architecture.  Only the output layer differs in the neuron cardinality: the multilabel model has one for each \sdoh\ label (6) and the binary model has one.

% example is present tense
\zfRef{trad-model} shows the three components that take the sentence as input:
\begin{itemize}
\item \textbf{\ac{roberta} (base) model's last layer}: The sentence is first tokenized and applied to the model.
\item \textbf{\cui\ extraction}: First \medcat\ links tokens to concepts.  The \cui\ for ``Homelessness'' (\texttt{C0019863}) is linked to the tokens ``ran away'' using preferred name ``Ran away, life event'' \zsseesec{cui-feature}.  This text is then used as input to \sbert, but the parameters of the \sbert\ model are not updated \zsseesec{cui-feature}.
\item \textbf{One-hot encoded features}: Vectors are encoded from enumerated linguistic values, such as part-of-speech tags. One-hot encoded features are: \texttt{POS}, \texttt{Dep}, \texttt{Ent}, \texttt{MedEnt} and \texttt{TokSDoH} \ztsee{featureDescTab}.
\end{itemize}

Each of these components take the sentence as input and are used in parallel to create enriched embeddings for each \wpt.  The components' output are then concatenated so that each \wpt\ has the \roberta\ last layer embedding, last layer \sbert\ embedding, and the one-hot encode vectors.  The concatenated tokens and features are then passed through a two layer 1D \ac{cnn}.  Finally, the last fully connected linear layer learns to decode the convolutional to \sdoh\ label.  A threshold for each neuron determines if the output is considered as present.


\zssubsubsec[twosteparch]{\Twostep\ model}

The \twostep\ model first uses the binary model to detect whether a sentence has one or more \sdohs.  For those that do, it then utilizes a larger more costly model with more precision for the multilabel classification\footnote{We joined the prediction data to measure performance and latency to simulate the classifier, but the implementation would be trivial.} such as a \llm.  Our results report the performance of the traditional deep learning binary model with the \llamaeight\ on the \mimic\ dataset.  We believe the results of the \twostep\ on the \mimthetic\ dataset would be higher, but leave this as a future work.

\zssec{Evaluation}

Instead of using the \getal\ \mimic\ and synthetic datasets for testing, we split them into train, validation, and test splits.  We then use these splits for all non-cross-validated tests to evaluate the traditional deep learning, \llamaeight\ and \llamasev\ models.  The evaluation was done on \mimic\ dataset and then again on the \mimic\ dataset with the synthetic data added in a similar fashion to the \getal\ experiments.  A 10-fold cross validation with \cvrepeats\ repeats was also used for evaluation.

The \scikitlearnurl\ multilabel and performance libraries were used to compute all metrics.  The model evaluation metrics included weighted, micro and macro average performance metrics on the multilabel iterative stratified~\cite{sechidisStratificationMultilabelData2011} splits.

All models were trained, tested, and validated on the splits described in \zssecref{data}.  The same train, validation, and test splits were used across the \llm\ and traditional models.  However, the traditional deep learning binary classifier on the \mimic\ dataset was evaluated with a 10-fold cross validation with \cvrepeats\ repeats\footnote{Cross-validation on the \llms\ were prohibitively expensive.}.  The \mimthetic\ multilabel classifier was also cross-validated with the same parameters set.

Micro, macro, and weighted averages were calculated using the following:
 %https://vitalflux.com/micro-average-macro-average-scoring-metrics-multi-class-classification-python/
\noindent{}Let:
\begin{zlpackeditemize}
\item $TP_i$, $FP_i$, $FN_i$ be the true positives, false positives, and false negatives for class $i$.
\item $N$ be the total number of classes.
\item $w_i$ be the weight for class $i$, typically the proportion of instances belonging to that class.
\end{zlpackeditemize}

\noindent{}Micro average:
\begin{eqnarray}
\textrm{P} &=& \frac{\sum_{i} TP_i}{\sum_{i} (TP_i + FP_i)} , \;
\textrm{R} = \frac{\sum_{i} TP_i}{\sum_{i} (TP_i + FN_i)} \nonumber \\
\textrm{F1} &=& \frac{2 \sum_{i} TP_i}{2 \sum_{i} TP_i + \sum_{i} FP_i + \sum_{i} FN_i} \nonumber
\end{eqnarray}

\noindent{}Macro average:
\begin{eqnarray}
\textrm{P} &=& \frac{1}{N} \sum_{i} \frac{TP_i}{TP_i + FP_i} , \;
\textrm{R} = \frac{1}{N} \sum_{i} \frac{TP_i}{TP_i + FN_i} \nonumber \\
\textrm{F1} &=& \frac{1}{n} \sum_{i=1}^{n} \left( 2 \times \frac{\frac{TP_i}{TP_i + FP_i} \times \frac{TP_i}{TP_i + FN_i}}{\frac{TP_i}{TP_i + FP_i} + \frac{TP_i}{TP_i + FN_i}} \right) \nonumber
\end{eqnarray}

\noindent{}Weighted average:
\begin{eqnarray}
\textrm{P} &=& \sum_{i} w_i \cdot \frac{TP_i}{TP_i + FP_i} , \;
\textrm{R} = \sum_{i} w_i \cdot \frac{TP_i}{TP_i + FN_i} \nonumber \\
\textrm{F1} &=& \sum_{i=1}^{n} w_i \left( 2 \times \frac{\frac{TP_i}{TP_i + FP_i} \times \frac{TP_i}{TP_i + FN_i}}{\frac{TP_i}{TP_i + FP_i} + \frac{TP_i}{TP_i + FN_i}} \right) \nonumber
\end{eqnarray}


\zssec[data-avail]{Data and code availability}

The \mimic\ and synthetic datasets are available on \getalsource[GitHub].  Our
\sdohllmmodeleight\ and \sdohllmmodelsev\ \llm\ models are hosted on the
HuggingFace Hub, and the traditional deep learning trained models are available
on \sdohtradmodel.
%\zssec[code-avail]{Code availability}
The source code for all experiments (including reusable Python libraries for
the research community) and our dataset splits are available on
\sdohsrcurl[GitHub].

\zssec[data-avail]{Acknowledgments}

This work was funded by an award from the Center for Health Equity using Machine
Learning and Artificial Intelligence (CHEMA) postdoctoral funding award at the
University of Illinois Chicago.

\begin{zlprompt}[\textwidth]{few-shot-prompt}{Few-shot prompt}{%
    Our prompt used for \sdoh\ prediction with definitions and examples take from
    the \zeciteauthor{\sdohidct} annotation guide.}
Classify sentences for social determinants of health (SDOH).  Definitions SDOHs are given in the below list:

* `housing`: The status of a patient's housing is a critical SDOH, known to affect the outcome of treatment. For the purposes of this annotation task, a sentence will be annotated as housing if it expresses a challenge relating to the place of residence of the patient. Please note that references to cities and towns, without mention of specific housing should NOT be considered an SDOH annotation. Attributes are Poor, Undomiciled, Other.

* `transportation`: This SDOH pertains to a patient's inability to get to/from their healthcare visits.. A patient being present at the treatment location, even if explicitly textually represented, or discussions of transportation unrelated to adequacy of transportation access, should NOT be considered an instance of Transportation SDOH. However, if there is a case of explicit textual representation that a patient is absent for treatment and that absence is due to transportation issues, then this IS considered an instance of Transportation SDOH. Attributes are Distance, Resource, Other.

* `relationship`: Whether or not a patient is in a partnered relationship is an abundant SDOH in the clinical notes. A sentence represents relationship status if it expresses evidence that a patient is married, in a partnership, divorced/separated, single, or widowed. Attributes are Married, Partnered, Divorced, Widowed, Single.

* `parent`: This SDOH should be used for descriptions of a patient being a parent to at least one child who is a minor (under the age of 18 years old). Tthe only evidence necessary for this SDOH is the existence of a patient's child under the age of 18. For the purposes of this task, "teenage children" can be considered minors. This SDOH category is binary and has no attributes, so the full annotation will just be the SDOH.

* `employment`: This SDOH pertains to expressions of a patient's employment status. A sentence should be annotated as an Employment Status SDOH if it expresses if the patient is employed (a paid job), unemployed, retired, or a current student. Attributes are Employed, Unemployed, Under-Employed, Disability, Retired, Student.

* `support`: This SDOH is a sentence describes a patient that is actively receiving care support, such as emotional, health, financial support.  This support comes from family and friends but not health care professionals.  The sentence must describe an act of care, participation in the patient's care, or an explicit statement that the person in the patient's life is "supportive", "caring for them", etc. In these cases, we wish to capture a patient's Social Support with this annotation. 

Here are some examples of "Sentence" input and "SDOH labels" you output:

### Sentence:Pt lives in Arlington.
### SDOH labels:```housing```

### Sentence:Pt lives 30mi away from hospital and and complains about needing to transfer three times each way.
### SDOH labels:```transportation```

### Sentence:Pt and her husband came into my office today.
### SDOH labels:```relationship```

### Sentence:Pt has 2 children ages 9 and 13.
### SDOH labels:```parent```

### Sentence:Pt works as an electrician in Rockland.
### SDOH labels:```employment```

### Sentence:Here today is Pt, her daughter, and supportive wife
### SDOH labels:```support```

Now classify the sentence with a comma-separated list of labels that are mostly likely to be present.  Only output the labels (or ```-``` for no SDOH found) surrounded by three back ticks.

### Sentence:{{ text }}
### SDOH labels:
\end{zlprompt}

\begin{zlprompt}[\textwidth]{train-prompt}{Training prompt}{%
    Our prompt used for supervised fine-tuned training of \sdoh\ prediction
    with examples take from the \zeciteauthor{\sdohidct} annotation guide.}
Classify sentences for social determinants of health (SDOH).

Definitions SDOHs are given with labels in back ticks:

* `housing`: The status of a patient's housing is a critical SDOH, known to affect the outcome of treatment.

* `transportation`: This SDOH pertains to a patient's inability to get to/from their healthcare visits.

* `relationship`: Whether or not a patient is in a partnered relationship is an abundant SDOH in the clinical notes.

* `parent`: This SDOH should be used for descriptions of a patient being a parent to at least one child who is a minor (under the age of 18 years old).

* `employment`: This SDOH pertains to expressions of a patient's employment status. A sentence should be annotated as an Employment Status SDOH if it expresses if the patient is employed (a paid job), unemployed, retired, or a current student.

* `support`: This SDOH is a sentence describes a patient that is actively receiving care support, such as emotional, health, financial support.  This support comes from family and friends but not health care professionals.

* `-`: If no SDOH is found.

Now classify sentences for social determinants of health (SDOH) as a list labels in three back ticks. The sentence can be a member of multiple classes so output the labels that are mostly likely to be present.

### Sentence: {{ text }}
### SDOH labels: ```{{ labels }}```
\end{zlprompt}

% $ biblatex auxiliary file $
% $ biblatex bbl format version 3.2 $
% Do not modify the above lines!
%
% This is an auxiliary file used by the 'biblatex' package.
% This file may safely be deleted. It will be recreated by
% biber as required.
%
\begingroup
\makeatletter
\@ifundefined{ver@biblatex.sty}
  {\@latex@error
     {Missing 'biblatex' package}
     {The bibliography requires the 'biblatex' package.}
      \aftergroup\endinput}
  {}
\endgroup


\refsection{0}
  \datalist[entry]{none/global//global/global}
    \entry{hill-briggsSocialDeterminantsHealth2021}{article}{}
      \name{author}{8}{}{%
        {{hash=26c0545418813c15dfddd1a0cd87a428}{%
           family={Hill-Briggs},
           familyi={H\bibinithyphendelim B\bibinitperiod},
           given={Felicia},
           giveni={F\bibinitperiod}}}%
        {{hash=86ca2ab3b6319d81e15ddb1665faf65b}{%
           family={Adler},
           familyi={A\bibinitperiod},
           given={Nancy\bibnamedelima E.},
           giveni={N\bibinitperiod\bibinitdelim E\bibinitperiod}}}%
        {{hash=5210545ab364007a031f272d8a5e182f}{%
           family={Berkowitz},
           familyi={B\bibinitperiod},
           given={Seth\bibnamedelima A.},
           giveni={S\bibinitperiod\bibinitdelim A\bibinitperiod}}}%
        {{hash=a178cf5382ca632c773f114c7dde3f47}{%
           family={Chin},
           familyi={C\bibinitperiod},
           given={Marshall\bibnamedelima H.},
           giveni={M\bibinitperiod\bibinitdelim H\bibinitperiod}}}%
        {{hash=8e4b36e1bf6ce89a88d52812d32c2202}{%
           family={Gary-Webb},
           familyi={G\bibinithyphendelim W\bibinitperiod},
           given={Tiffany\bibnamedelima L.},
           giveni={T\bibinitperiod\bibinitdelim L\bibinitperiod}}}%
        {{hash=39876a0ae590b9456795bdc72410641f}{%
           family={Navas-Acien},
           familyi={N\bibinithyphendelim A\bibinitperiod},
           given={Ana},
           giveni={A\bibinitperiod}}}%
        {{hash=0fab945636e388bf3d6266edfeb6b831}{%
           family={Thornton},
           familyi={T\bibinitperiod},
           given={Pamela\bibnamedelima L.},
           giveni={P\bibinitperiod\bibinitdelim L\bibinitperiod}}}%
        {{hash=7485244f3c5e3894329afb1ab4265b78}{%
           family={Haire-Joshu},
           familyi={H\bibinithyphendelim J\bibinitperiod},
           given={Debra},
           giveni={D\bibinitperiod}}}%
      }
      \strng{namehash}{3c6be19d1c7ff49a4e52f6e0704bdbb9}
      \strng{fullhash}{21560e9a598cfd228711f1ccca4b6f09}
      \strng{bibnamehash}{3c6be19d1c7ff49a4e52f6e0704bdbb9}
      \strng{authorbibnamehash}{3c6be19d1c7ff49a4e52f6e0704bdbb9}
      \strng{authornamehash}{3c6be19d1c7ff49a4e52f6e0704bdbb9}
      \strng{authorfullhash}{21560e9a598cfd228711f1ccca4b6f09}
      \field{sortinit}{1}
      \field{sortinithash}{4f6aaa89bab872aa0999fec09ff8e98a}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{shorttitle}
      \field{eprinttype}{pubmed}
      \field{issn}{0149-5992}
      \field{journaltitle}{Diabetes Care}
      \field{month}{1}
      \field{number}{1}
      \field{shortjournal}{Diabetes Care}
      \field{shorttitle}{Social {{Determinants}} of {{Health}} and {{Diabetes}}}
      \field{title}{Social {{Determinants}} of {{Health}} and {{Diabetes}}: {{A Scientific Review}}}
      \field{urlday}{4}
      \field{urlmonth}{10}
      \field{urlyear}{2024}
      \field{volume}{44}
      \field{year}{2021}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \field{pages}{258\bibrangedash 279}
      \range{pages}{22}
      \verb{doi}
      \verb 10.2337/dci20-0053
      \endverb
      \verb{eprint}
      \verb 33139407
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/III5XV86/Hill-Briggs et al. - 2021 - Social Determinants of Health and Diabetes A Scientific Review.pdf
      \endverb
      \verb{urlraw}
      \verb https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7783927/
      \endverb
      \verb{url}
      \verb https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7783927/
      \endverb
    \endentry
    \entry{lyerlaRecurrentDKAResults2021}{article}{}
      \name{author}{6}{}{%
        {{hash=09b5163c3f250b97be553045dca446c1}{%
           family={Lyerla},
           familyi={L\bibinitperiod},
           given={Ryan},
           giveni={R\bibinitperiod}}}%
        {{hash=deeed9fb1aae26e353b452abab100bd3}{%
           family={Johnson-Rabbett},
           familyi={J\bibinithyphendelim R\bibinitperiod},
           given={Brianna},
           giveni={B\bibinitperiod}}}%
        {{hash=bfb2dbc6a1b5717346cdf88f31a9cc46}{%
           family={Shakally},
           familyi={S\bibinitperiod},
           given={Almoutaz},
           giveni={A\bibinitperiod}}}%
        {{hash=6239f36e7db6833e445df2c0c1bdbfc7}{%
           family={Magar},
           familyi={M\bibinitperiod},
           given={Rekha},
           giveni={R\bibinitperiod}}}%
        {{hash=767c91bf80b6ba3510bbe3116962d223}{%
           family={Alameddine},
           familyi={A\bibinitperiod},
           given={Hind},
           giveni={H\bibinitperiod}}}%
        {{hash=8131a0e6e102ef8d80d6489e1c0ba68c}{%
           family={Fish},
           familyi={F\bibinitperiod},
           given={Lisa},
           giveni={L\bibinitperiod}}}%
      }
      \strng{namehash}{e036531c06938902094bb3216c8c051b}
      \strng{fullhash}{1d23fc23cc1ffa4bb37e3f1e546c9d9a}
      \strng{bibnamehash}{e036531c06938902094bb3216c8c051b}
      \strng{authorbibnamehash}{e036531c06938902094bb3216c8c051b}
      \strng{authornamehash}{e036531c06938902094bb3216c8c051b}
      \strng{authorfullhash}{1d23fc23cc1ffa4bb37e3f1e546c9d9a}
      \field{sortinit}{2}
      \field{sortinithash}{8b555b3791beccb63322c22f3320aa9a}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{abstract}{AIMS: Diabetic ketoacidosis (DKA) is an emergency with high morbidity and mortality. This study examined patient factors associated with hospitalization for recurrent DKA. METHODS: Characteristics of 265 subjects admitted for DKA at Hennepin County Medical Center between January 2017 and January 2019 were retrospectively analyzed. Differences between subjects with a single admission versus multiple were reviewed. RESULTS: Forty-eight out of 265 patients had recurrent DKA. Risk factors included African American race (adjusted odds ratio (aOR) versus white non-Hispanic\,=\,4.6, 95\% CI 1.8-13, p\,=\,0.001) or other race/ethnicity (aOR\,=\,8.6, 2.9-28, p\,{$<$}\,0.0001), younger age (aOR 37-52y versus 18-36y\,=\,0.48, 0.19-1.16, p\,=\,0.10; aOR 53-99y versus 18-36y\,=\,0.37, 0.12-0.99, p\,=\,0.05), type 1 diabetes mellitus (aOR\,=\,2.4, 1.1-5.5, p\,=\,0.04), ever homeless (aOR\,=\,2.5, 1.1-5.4, p\,=\,0.03), and drug abuse (aOR\,=\,3.2, 1.3-7.8, p\,=\,0.009). DKA cost a median of \$29,981 per admission. CONCLUSIONS: Recurrent DKA is costly, and social determinants are strong predictors of recurrence. This study highlights the need for targeted preventative care programs.}
      \field{day}{1}
      \field{eprinttype}{pubmed}
      \field{issn}{2055-8260}
      \field{journaltitle}{Clinical Diabetes and Endocrinology}
      \field{langid}{english}
      \field{month}{8}
      \field{number}{1}
      \field{shortjournal}{Clin Diabetes Endocrinol}
      \field{title}{Recurrent {{DKA}} Results in High Societal Costs - a Retrospective Study Identifying Social Predictors of Recurrence for Potential Future Intervention}
      \field{volume}{7}
      \field{year}{2021}
      \field{dateera}{ce}
      \field{pages}{13}
      \range{pages}{1}
      \verb{doi}
      \verb 10.1186/s40842-021-00127-6
      \endverb
      \verb{eprint}
      \verb 34332631
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/YFRSMVJM/Lyerla et al. - 2021 - Recurrent DKA results in high societal costs - a retrospective study identifying social predictors o.pdf
      \endverb
      \keyw{Barriers to care,Insulin cost,Recurrent DKA}
    \endentry
    \entry{keenanSocialFactorsAssociated2002}{article}{}
      \name{author}{3}{}{%
        {{hash=57dc5bf6d5c766421e26177484c45a7f}{%
           family={Keenan},
           familyi={K\bibinitperiod},
           given={Heather},
           giveni={H\bibinitperiod}}}%
        {{hash=d722401ad1d8e477d6613d9610f7a90a}{%
           family={Foster},
           familyi={F\bibinitperiod},
           given={Carol},
           giveni={C\bibinitperiod}}}%
        {{hash=a505751887c37d5ed71c04ff6f4a3e09}{%
           family={Bratton},
           familyi={B\bibinitperiod},
           given={Susan},
           giveni={S\bibinitperiod}}}%
      }
      \list{publisher}{1}{%
        {Pediatrics}%
      }
      \strng{namehash}{37ee3468e432400b3fd4693262f3f6ba}
      \strng{fullhash}{7aaa23c672252db5a6b67a852dc5a067}
      \strng{bibnamehash}{7aaa23c672252db5a6b67a852dc5a067}
      \strng{authorbibnamehash}{7aaa23c672252db5a6b67a852dc5a067}
      \strng{authornamehash}{37ee3468e432400b3fd4693262f3f6ba}
      \strng{authorfullhash}{7aaa23c672252db5a6b67a852dc5a067}
      \field{sortinit}{3}
      \field{sortinithash}{ad6fe7482ffbd7b9f99c9e8b5dccd3d7}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{abstract}{When compared with state census data, nonwhite and poor children were more likely to be admitted with complications of DM and to have significantly prolonged and expensive hospital stays. These children should be targeted for intensive diabetes education and outpatient medical support both to improv …}
      \field{eprinttype}{pubmed}
      \field{issn}{1098-4275}
      \field{journaltitle}{Pediatrics}
      \field{langid}{english}
      \field{month}{1}
      \field{number}{1}
      \field{title}{Social Factors Associated with Prolonged Hospitalization among Diabetic Children}
      \field{urlday}{4}
      \field{urlmonth}{10}
      \field{urlyear}{2024}
      \field{volume}{109}
      \field{year}{2002}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \verb{doi}
      \verb 10.1542/peds.109.1.40
      \endverb
      \verb{eprint}
      \verb 11773540
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/8UJM4FTQ/11773540.html
      \endverb
      \verb{urlraw}
      \verb https://pubmed.ncbi.nlm.nih.gov/11773540/
      \endverb
      \verb{url}
      \verb https://pubmed.ncbi.nlm.nih.gov/11773540/
      \endverb
    \endentry
    \entry{liRealizingPotentialSocial2024}{article}{}
      \name{author}{16}{}{%
        {{hash=38982a068d993b656747eda3c1d05082}{%
           family={Li},
           familyi={L\bibinitperiod},
           given={Chenyu},
           giveni={C\bibinitperiod}}}%
        {{hash=05f1279cb767b015c0865cf88c573227}{%
           family={Mowery},
           familyi={M\bibinitperiod},
           given={Danielle\bibnamedelima L.},
           giveni={D\bibinitperiod\bibinitdelim L\bibinitperiod}}}%
        {{hash=3724047c567c474cef1765d0a3d43b4d}{%
           family={Ma},
           familyi={M\bibinitperiod},
           given={Xiaomeng},
           giveni={X\bibinitperiod}}}%
        {{hash=c4f0c9678fb69ebf79ff4210b385eee5}{%
           family={Yang},
           familyi={Y\bibinitperiod},
           given={Rui},
           giveni={R\bibinitperiod}}}%
        {{hash=b67a48c59362c0f00a93fb2a42664f68}{%
           family={Vurgun},
           familyi={V\bibinitperiod},
           given={Ugurcan},
           giveni={U\bibinitperiod}}}%
        {{hash=5f1a06819bdffa714b9cd1acd4200881}{%
           family={Hwang},
           familyi={H\bibinitperiod},
           given={Sy},
           giveni={S\bibinitperiod}}}%
        {{hash=a43ae518e5c56fdea08a6ad2acdbd17b}{%
           family={Donnelly},
           familyi={D\bibinitperiod},
           given={Hayoung\bibnamedelima K.},
           giveni={H\bibinitperiod\bibinitdelim K\bibinitperiod}}}%
        {{hash=06d2672fcb7615b01323ed7b427e8b01}{%
           family={Bandhey},
           familyi={B\bibinitperiod},
           given={Harsh},
           giveni={H\bibinitperiod}}}%
        {{hash=7de5de10edad55acd0b3fbd7ddcd1f24}{%
           family={Senathirajah},
           familyi={S\bibinitperiod},
           given={Yalini},
           giveni={Y\bibinitperiod}}}%
        {{hash=039552d1a26da0c11fec71189a7e414c}{%
           family={Visweswaran},
           familyi={V\bibinitperiod},
           given={Shyam},
           giveni={S\bibinitperiod}}}%
        {{hash=d68ab78bd8cfa37a0872050879a414f2}{%
           family={Sadhu},
           familyi={S\bibinitperiod},
           given={Eugene\bibnamedelima M.},
           giveni={E\bibinitperiod\bibinitdelim M\bibinitperiod}}}%
        {{hash=7c0fbe2d5a7ddb67570070946d23f548}{%
           family={Akhtar},
           familyi={A\bibinitperiod},
           given={Zohaib},
           giveni={Z\bibinitperiod}}}%
        {{hash=ab919039e04cf515ca7512c1afe5b810}{%
           family={Getzen},
           familyi={G\bibinitperiod},
           given={Emily},
           giveni={E\bibinitperiod}}}%
        {{hash=7bbd76f5d74686263dc404ea083c07c9}{%
           family={Freda},
           familyi={F\bibinitperiod},
           given={Philip\bibnamedelima J.},
           giveni={P\bibinitperiod\bibinitdelim J\bibinitperiod}}}%
        {{hash=e6845a6257e44a30d9df2a428e1c68f9}{%
           family={Long},
           familyi={L\bibinitperiod},
           given={Qi},
           giveni={Q\bibinitperiod}}}%
        {{hash=83247025303f755f7e698a858ff6b421}{%
           family={Becich},
           familyi={B\bibinitperiod},
           given={Michael\bibnamedelima J.},
           giveni={M\bibinitperiod\bibinitdelim J\bibinitperiod}}}%
      }
      \strng{namehash}{3e66b3b521e3da82a91d4aeb6a59c360}
      \strng{fullhash}{7a8a477c58926b9dc09a30d9322a6d68}
      \strng{bibnamehash}{3e66b3b521e3da82a91d4aeb6a59c360}
      \strng{authorbibnamehash}{3e66b3b521e3da82a91d4aeb6a59c360}
      \strng{authornamehash}{3e66b3b521e3da82a91d4aeb6a59c360}
      \strng{authorfullhash}{7a8a477c58926b9dc09a30d9322a6d68}
      \field{sortinit}{4}
      \field{sortinithash}{9381316451d1b9788675a07e972a12a7}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{shorttitle}
      \field{abstract}{Background:Social determinants of health (SDoH), such as socioeconomics and neighborhoods, strongly influence health outcomes. However, the current state of standardized SDoH data in electronic health records (EHRs) is lacking, a significant barrier to research and care quality.Methods:We conducted a PubMed search using “SDOH” and “EHR” Medical Subject Headings terms, analyzing included articles across five domains: 1) SDoH screening and assessment approaches, 2) SDoH data collection and documentation, 3) Use of natural language processing (NLP) for extracting SDoH, 4) SDoH data and health outcomes, and 5) SDoH-driven interventions.Results:Of 685 articles identified, 324 underwent full review. Key findings include implementation of tailored screening instruments, census and claims data linkage for contextual SDoH profiles, NLP systems extracting SDoH from notes, associations between SDoH and healthcare utilization and chronic disease control, and integrated care management programs. However, variability across data sources, tools, and outcomes underscores the need for standardization.Discussion:Despite progress in identifying patient social needs, further development of standards, predictive models, and coordinated interventions is critical for SDoH-EHR integration. Additional database searches could strengthen this scoping review. Ultimately, widespread capture, analysis, and translation of multidimensional SDoH data into clinical care is essential for promoting health equity.}
      \field{issn}{2059-8661}
      \field{journaltitle}{Journal of Clinical and Translational Science}
      \field{langid}{english}
      \field{month}{1}
      \field{number}{1}
      \field{shorttitle}{Realizing the Potential of Social Determinants Data in {{EHR}} Systems}
      \field{title}{Realizing the Potential of Social Determinants Data in {{EHR}} Systems: {{A}} Scoping Review of Approaches for Screening, Linkage, Extraction, Analysis, and Interventions}
      \field{urlday}{18}
      \field{urlmonth}{3}
      \field{urlyear}{2025}
      \field{volume}{8}
      \field{year}{2024}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \field{pages}{e147}
      \range{pages}{-1}
      \verb{doi}
      \verb 10.1017/cts.2024.571
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/U7IGBREW/Li et al. - 2024 - Realizing the potential of social determinants data in EHR systems A scoping review of approaches f.pdf
      \endverb
      \verb{urlraw}
      \verb https://www.cambridge.org/core/journals/journal-of-clinical-and-translational-science/article/realizing-the-potential-of-social-determinants-data-in-ehr-systems-a-scoping-review-of-approaches-for-screening-linkage-extraction-analysis-and-interventions/158E0DF4F22EE33E2E4957E784637D26#
      \endverb
      \verb{url}
      \verb https://www.cambridge.org/core/journals/journal-of-clinical-and-translational-science/article/realizing-the-potential-of-social-determinants-data-in-ehr-systems-a-scoping-review-of-approaches-for-screening-linkage-extraction-analysis-and-interventions/158E0DF4F22EE33E2E4957E784637D26#
      \endverb
      \keyw{electronic health records,health equity,natural language processing,Social determinants of health,social risk factors}
    \endentry
    \entry{wangDocumentationReviewSocial2021}{article}{}
      \name{author}{4}{}{%
        {{hash=405aa02bca140f939bbe12e95a79804b}{%
           family={Wang},
           familyi={W\bibinitperiod},
           given={Michael},
           giveni={M\bibinitperiod}}}%
        {{hash=19cfb6097c7466dc7b027f6eceb2e9ba}{%
           family={Pantell},
           familyi={P\bibinitperiod},
           given={Matthew\bibnamedelima S},
           giveni={M\bibinitperiod\bibinitdelim S\bibinitperiod}}}%
        {{hash=0d448c3bbb5324c45bb79a87582797e3}{%
           family={Gottlieb},
           familyi={G\bibinitperiod},
           given={Laura\bibnamedelima M},
           giveni={L\bibinitperiod\bibinitdelim M\bibinitperiod}}}%
        {{hash=a2c3c364469a23f62bf47134184d2c84}{%
           family={Adler-Milstein},
           familyi={A\bibinithyphendelim M\bibinitperiod},
           given={Julia},
           giveni={J\bibinitperiod}}}%
      }
      \strng{namehash}{12ec4b257b27f7a7367538c6509303c5}
      \strng{fullhash}{ea44c194f09932aee45b0f69a3065070}
      \strng{bibnamehash}{ea44c194f09932aee45b0f69a3065070}
      \strng{authorbibnamehash}{ea44c194f09932aee45b0f69a3065070}
      \strng{authornamehash}{12ec4b257b27f7a7367538c6509303c5}
      \strng{authorfullhash}{ea44c194f09932aee45b0f69a3065070}
      \field{extraname}{1}
      \field{sortinit}{4}
      \field{sortinithash}{9381316451d1b9788675a07e972a12a7}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{shorttitle}
      \field{abstract}{Electronic Health Records (EHRs) increasingly include designated fields to capture social determinants of health (SDOH). We developed measures to characterize their use, and use of other SDOH data types, to optimize SDOH data integration.We developed 3 measures that accommodate different EHR data types on an encounter or patient-year basis. We implemented these measures—documented during encounter (DDE) captures documentation occurring during the encounter; documented by discharge (DBD) includes DDE plus documentation occurring any time prior to admission; and reviewed during encounter (RDE) captures whether anyone reviewed documented data—for the newly available structured SDOH fields and 4 other comparator SDOH data types (problem list, inpatient nursing question, social history free text, and social work notes) on a hospital encounter basis (with patient-year metrics in the Supplementary Appendix). Our sample included all patients (n\,=\,27 127) with at least one hospitalization at UCSF Health (a large, urban, tertiary medical center) over a 1-year period.We observed substantial variation in the use of different SDOH EHR data types. Notably, social history question fields (newly added at study period start) were rarely used (DDE: 0.03\% of encounters, DBD: 0.26\%, RDE: 0.03\%). Free-text patient social history fields had higher use (DDE: 12.1\%, DBD: 49.0\%, RDE: 14.4\%).Our measures of real-world SDOH data use can guide current efforts to capture and leverage these data. For our institution, measures revealed substantial variation across data types, suggesting the need to engage in efforts such as EHR-user education and targeted workflow integration.Measures revealed opportunities to optimize SDOH data documentation and review.}
      \field{day}{1}
      \field{issn}{1527-974X}
      \field{journaltitle}{Journal of the American Medical Informatics Association}
      \field{month}{12}
      \field{number}{12}
      \field{shortjournal}{Journal of the American Medical Informatics Association}
      \field{shorttitle}{Documentation and Review of Social Determinants of Health Data in the {{EHR}}}
      \field{title}{Documentation and Review of Social Determinants of Health Data in the {{EHR}}: Measures and Associated Insights}
      \field{urlday}{18}
      \field{urlmonth}{3}
      \field{urlyear}{2025}
      \field{volume}{28}
      \field{year}{2021}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \field{pages}{2608\bibrangedash 2616}
      \range{pages}{9}
      \verb{doi}
      \verb 10.1093/jamia/ocab194
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/XVJ75RQE/Wang et al. - 2021 - Documentation and review of social determinants of health data in the EHR measures and associated i.pdf;/Users/landes/opt/var/zotero/storage/E29CTNEP/6373497.html
      \endverb
      \verb{urlraw}
      \verb https://doi.org/10.1093/jamia/ocab194
      \endverb
      \verb{url}
      \verb https://doi.org/10.1093/jamia/ocab194
      \endverb
    \endentry
    \entry{goldAdoptionSocialDeterminants2018}{article}{}
      \name{author}{13}{}{%
        {{hash=fafa3d6f03f039972195cbfe9a0cfd5b}{%
           family={Gold},
           familyi={G\bibinitperiod},
           given={Rachel},
           giveni={R\bibinitperiod}}}%
        {{hash=9739bf2e3ce3b80df4b468dca0b86ae2}{%
           family={Bunce},
           familyi={B\bibinitperiod},
           given={Arwen},
           giveni={A\bibinitperiod}}}%
        {{hash=d6067d323403f10a7fdbeb392805e48d}{%
           family={Cowburn},
           familyi={C\bibinitperiod},
           given={Stuart},
           giveni={S\bibinitperiod}}}%
        {{hash=3e0af9d06080d4b8cdc84b3507898d06}{%
           family={Dambrun},
           familyi={D\bibinitperiod},
           given={Katie},
           giveni={K\bibinitperiod}}}%
        {{hash=fec141c85f9f99f518024d17d916e303}{%
           family={Dearing},
           familyi={D\bibinitperiod},
           given={Marla},
           giveni={M\bibinitperiod}}}%
        {{hash=578bf730048040ef0d25a6151b809115}{%
           family={Middendorf},
           familyi={M\bibinitperiod},
           given={Mary},
           giveni={M\bibinitperiod}}}%
        {{hash=3eecc708b0dec7f3e83d52465f1cc83a}{%
           family={Mossman},
           familyi={M\bibinitperiod},
           given={Ned},
           giveni={N\bibinitperiod}}}%
        {{hash=47d9443ea7f3b31847ef7966ef0b8c32}{%
           family={Hollombe},
           familyi={H\bibinitperiod},
           given={Celine},
           giveni={C\bibinitperiod}}}%
        {{hash=e56b6a41f36c2e6ba973c814e5d601dc}{%
           family={Mahr},
           familyi={M\bibinitperiod},
           given={Peter},
           giveni={P\bibinitperiod}}}%
        {{hash=52009410eb5b2ba7aa44db7729b51d3e}{%
           family={Melgar},
           familyi={M\bibinitperiod},
           given={Gerardo},
           giveni={G\bibinitperiod}}}%
        {{hash=55844b5e6e88aae765588dd1d8e21c8d}{%
           family={Davis},
           familyi={D\bibinitperiod},
           given={James},
           giveni={J\bibinitperiod}}}%
        {{hash=246da761869bd0de452a86b9f477b4e5}{%
           family={Gottlieb},
           familyi={G\bibinitperiod},
           given={Laura},
           giveni={L\bibinitperiod}}}%
        {{hash=8a0b996b2aeacc6d8cbaf4ebb897545c}{%
           family={Cottrell},
           familyi={C\bibinitperiod},
           given={Erika},
           giveni={E\bibinitperiod}}}%
      }
      \list{publisher}{1}{%
        {The Annals of Family Medicine}%
      }
      \strng{namehash}{c5535f44c9a2b0db368cc61bd849a9bb}
      \strng{fullhash}{406d1d4540a82d29010c0150deebde65}
      \strng{bibnamehash}{c5535f44c9a2b0db368cc61bd849a9bb}
      \strng{authorbibnamehash}{c5535f44c9a2b0db368cc61bd849a9bb}
      \strng{authornamehash}{c5535f44c9a2b0db368cc61bd849a9bb}
      \strng{authorfullhash}{406d1d4540a82d29010c0150deebde65}
      \field{sortinit}{4}
      \field{sortinithash}{9381316451d1b9788675a07e972a12a7}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{abstract}{PURPOSE This pilot study assessed the feasibility of implementing electronic health record (EHR) tools for collecting, reviewing, and acting on patient-reported social determinants of health (SDH) data in community health centers (CHCs). We believe it is the first such US study. METHODS We implemented a suite of SDH data tools in 3 Pacific Northwest CHCs in June 2016, and used mixed methods to assess their adoption through July 2017. We modified the tools at clinic request; for example, we added questions that ask if the patient wanted assistance with SDH needs. RESULTS Social determinants of health data were collected on 1,130 patients during the study period; 97\% to 99\% of screened patients (n = 1,098) had ≥1 SDH need documented in the EHR, of whom 211 (19\%) had an EHR-documented SDH referral. Only 15\% to 21\% of patients with a documented SDH need indicated wanting help. Examples of lessons learned on adoption of EHR SDH tools indicate that clinics should: consider how to best integrate tools into existing workflow processes; ensure that staff tasked with SDH efforts receive adequate tool training and access; and consider that timing of data entry impacts how and when SDH data can be used. CONCLUSIONS Our results indicate that adoption of systematic EHR-based SDH documentation may be feasible, but substantial barriers to adoption exist. Lessons from this study may inform primary care providers seeking to implement SDH-related efforts, and related health policies. Far more research is needed to address implementation barriers related to SDH documentation in EHRs.}
      \field{day}{1}
      \field{eprinttype}{pubmed}
      \field{issn}{1544-1709, 1544-1717}
      \field{journaltitle}{The Annals of Family Medicine}
      \field{langid}{english}
      \field{month}{9}
      \field{number}{5}
      \field{title}{Adoption of {{Social Determinants}} of {{Health EHR Tools}} by {{Community Health Centers}}}
      \field{urlday}{18}
      \field{urlmonth}{3}
      \field{urlyear}{2025}
      \field{volume}{16}
      \field{year}{2018}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \field{pages}{399\bibrangedash 407}
      \range{pages}{9}
      \verb{doi}
      \verb 10.1370/afm.2275
      \endverb
      \verb{eprint}
      \verb 30201636
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/IPA296LE/Gold et al. - 2018 - Adoption of Social Determinants of Health EHR Tools by Community Health Centers.pdf
      \endverb
      \verb{urlraw}
      \verb https://www.annfammed.org/content/16/5/399
      \endverb
      \verb{url}
      \verb https://www.annfammed.org/content/16/5/399
      \endverb
      \keyw{community health centers,electronic health records,implementation,social determinants of health}
    \endentry
    \entry{guevaraLargeLanguageModels2024}{article}{}
      \name{author}{15}{}{%
        {{hash=0084ad7c48ec7335059f62b5b3da3e65}{%
           family={Guevara},
           familyi={G\bibinitperiod},
           given={Marco},
           giveni={M\bibinitperiod}}}%
        {{hash=83a50488c5c529f30eeb030cbc13a67e}{%
           family={Chen},
           familyi={C\bibinitperiod},
           given={Shan},
           giveni={S\bibinitperiod}}}%
        {{hash=0f44696b1fdfd82fbff117ba201c8d5e}{%
           family={Thomas},
           familyi={T\bibinitperiod},
           given={Spencer},
           giveni={S\bibinitperiod}}}%
        {{hash=95261b210bc3d0e1cb6b590f33f493ee}{%
           family={Chaunzwa},
           familyi={C\bibinitperiod},
           given={Tafadzwa\bibnamedelima L.},
           giveni={T\bibinitperiod\bibinitdelim L\bibinitperiod}}}%
        {{hash=216504fd38a657b4bf362f4ff48b9da9}{%
           family={Franco},
           familyi={F\bibinitperiod},
           given={Idalid},
           giveni={I\bibinitperiod}}}%
        {{hash=d805b8d2b5b8ebb85f153aba41d6b628}{%
           family={Kann},
           familyi={K\bibinitperiod},
           given={Benjamin\bibnamedelima H.},
           giveni={B\bibinitperiod\bibinitdelim H\bibinitperiod}}}%
        {{hash=fc8e94b2cb2e672df8300739a9e924b2}{%
           family={Moningi},
           familyi={M\bibinitperiod},
           given={Shalini},
           giveni={S\bibinitperiod}}}%
        {{hash=7593ae83c290c2c23c5563792c37b6a5}{%
           family={Qian},
           familyi={Q\bibinitperiod},
           given={Jack\bibnamedelima M.},
           giveni={J\bibinitperiod\bibinitdelim M\bibinitperiod}}}%
        {{hash=4ed57b4a5bcae1c87ccfa6c90f33a8f2}{%
           family={Goldstein},
           familyi={G\bibinitperiod},
           given={Madeleine},
           giveni={M\bibinitperiod}}}%
        {{hash=35ca505880fa419e5add25b5d962b06f}{%
           family={Harper},
           familyi={H\bibinitperiod},
           given={Susan},
           giveni={S\bibinitperiod}}}%
        {{hash=7e34b4848990516b8fb636b59d4efaf2}{%
           family={Aerts},
           familyi={A\bibinitperiod},
           given={Hugo\bibnamedelimb J.\bibnamedelimi W.\bibnamedelimi L.},
           giveni={H\bibinitperiod\bibinitdelim J\bibinitperiod\bibinitdelim W\bibinitperiod\bibinitdelim L\bibinitperiod}}}%
        {{hash=871fa31b4e613f1f8af97f7ad5aec7cb}{%
           family={Catalano},
           familyi={C\bibinitperiod},
           given={Paul\bibnamedelima J.},
           giveni={P\bibinitperiod\bibinitdelim J\bibinitperiod}}}%
        {{hash=50fde930e06dd881d9a1d0f18bd12a71}{%
           family={Savova},
           familyi={S\bibinitperiod},
           given={Guergana\bibnamedelima K.},
           giveni={G\bibinitperiod\bibinitdelim K\bibinitperiod}}}%
        {{hash=c9b89fdb93bab884d0b97fe1b46f986a}{%
           family={Mak},
           familyi={M\bibinitperiod},
           given={Raymond\bibnamedelima H.},
           giveni={R\bibinitperiod\bibinitdelim H\bibinitperiod}}}%
        {{hash=9ff12b401fee2e13b7c2fa36782d9cd3}{%
           family={Bitterman},
           familyi={B\bibinitperiod},
           given={Danielle\bibnamedelima S.},
           giveni={D\bibinitperiod\bibinitdelim S\bibinitperiod}}}%
      }
      \list{publisher}{1}{%
        {Nature Publishing Group}%
      }
      \strng{namehash}{d4c3c36548b5cd73b805452ed8c4b417}
      \strng{fullhash}{2cb18eb961e52f28bebe5c11d9adc3fc}
      \strng{bibnamehash}{d4c3c36548b5cd73b805452ed8c4b417}
      \strng{authorbibnamehash}{d4c3c36548b5cd73b805452ed8c4b417}
      \strng{authornamehash}{d4c3c36548b5cd73b805452ed8c4b417}
      \strng{authorfullhash}{2cb18eb961e52f28bebe5c11d9adc3fc}
      \field{sortinit}{5}
      \field{sortinithash}{20e9b4b0b173788c5dace24730f47d8c}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{abstract}{Social determinants of health (SDoH) play a critical role in patient outcomes, yet their documentation is often missing or incomplete in the structured data of electronic health records (EHRs). Large language models (LLMs) could enable high-throughput extraction of SDoH from the EHR to support research and clinical care. However, class imbalance and data limitations present challenges for this sparsely documented yet critical information. Here, we investigated the optimal methods for using LLMs to extract six SDoH categories from narrative text in the EHR: employment, housing, transportation, parental status, relationship, and social support. The best-performing models were fine-tuned Flan-T5 XL for any SDoH mentions (macro-F1 0.71), and Flan-T5 XXL for adverse SDoH mentions (macro-F1 0.70). Adding LLM-generated synthetic data to training varied across models and architecture, but improved the performance of smaller Flan-T5 models (delta F1\,+\,0.12 to +0.23). Our best-fine-tuned models outperformed zero- and few-shot performance of ChatGPT-family models in the zero- and few-shot setting, except GPT4 with 10-shot prompting for adverse SDoH. Fine-tuned models were less likely than ChatGPT to change their prediction when race/ethnicity and gender descriptors were added to the text, suggesting less algorithmic bias (p\,{$<$}\,0.05). Our models identified 93.8\% of patients with adverse SDoH, while ICD-10 codes captured 2.0\%. These results demonstrate the potential of LLMs in improving real-world evidence on SDoH and assisting in identifying patients who could benefit from resource support.}
      \field{day}{11}
      \field{issn}{2398-6352}
      \field{journaltitle}{npj Digital Medicine}
      \field{langid}{english}
      \field{month}{1}
      \field{number}{1}
      \field{shortjournal}{npj Digit. Med.}
      \field{title}{Large Language Models to Identify Social Determinants of Health in Electronic Health Records}
      \field{urlday}{24}
      \field{urlmonth}{9}
      \field{urlyear}{2024}
      \field{volume}{7}
      \field{year}{2024}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \field{pages}{1\bibrangedash 14}
      \range{pages}{14}
      \verb{doi}
      \verb 10.1038/s41746-023-00970-0
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/JLAK48Q7/Guevara et al. - 2024 - Large language models to identify social determinants of health in electronic health records.pdf
      \endverb
      \verb{urlraw}
      \verb https://www.nature.com/articles/s41746-023-00970-0
      \endverb
      \verb{url}
      \verb https://www.nature.com/articles/s41746-023-00970-0
      \endverb
      \keyw{Health care,Machine learning}
    \endentry
    \entry{lituievAutomaticExtractionSocial2023}{article}{}
      \name{author}{6}{}{%
        {{hash=2f9d1b43bec21dbf18154a46979678a1}{%
           family={Lituiev},
           familyi={L\bibinitperiod},
           given={Dmytro\bibnamedelima S.},
           giveni={D\bibinitperiod\bibinitdelim S\bibinitperiod}}}%
        {{hash=0136bc9dc03e6dbad1aa416e7c2860ef}{%
           family={Lacar},
           familyi={L\bibinitperiod},
           given={Benjamin},
           giveni={B\bibinitperiod}}}%
        {{hash=3ba488e457f7ad90debfe9fb7e49acd1}{%
           family={Pak},
           familyi={P\bibinitperiod},
           given={Sang},
           giveni={S\bibinitperiod}}}%
        {{hash=b9732585d9cb83c9ca11c16ad46ed367}{%
           family={Abramowitsch},
           familyi={A\bibinitperiod},
           given={Peter\bibnamedelima L.},
           giveni={P\bibinitperiod\bibinitdelim L\bibinitperiod}}}%
        {{hash=7705d63f30ac3d1c4d5c687d7e994e0a}{%
           family={Marchis},
           familyi={M\bibinitperiod},
           given={Emilia\bibnamedelimb H.\bibnamedelimi De},
           giveni={E\bibinitperiod\bibinitdelim H\bibinitperiod\bibinitdelim D\bibinitperiod}}}%
        {{hash=033086bd36b1db5ed09eaca1534fb3ed}{%
           family={Peterson},
           familyi={P\bibinitperiod},
           given={Thomas\bibnamedelima A.},
           giveni={T\bibinitperiod\bibinitdelim A\bibinitperiod}}}%
      }
      \strng{namehash}{c63a9bfcad2a137976a95323e1e33fe8}
      \strng{fullhash}{224cf575670056b333deff03043c1eab}
      \strng{bibnamehash}{c63a9bfcad2a137976a95323e1e33fe8}
      \strng{authorbibnamehash}{c63a9bfcad2a137976a95323e1e33fe8}
      \strng{authornamehash}{c63a9bfcad2a137976a95323e1e33fe8}
      \strng{authorfullhash}{224cf575670056b333deff03043c1eab}
      \field{sortinit}{5}
      \field{sortinithash}{20e9b4b0b173788c5dace24730f47d8c}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{abstract}{We applied natural language processing and inference methods to extract social determinants of health (SDoH) information from clinical notes of patients with chronic low back pain (cLBP) to enhance future analyses of the associations between SDoH ...}
      \field{day}{13}
      \field{eprinttype}{pubmed}
      \field{journaltitle}{Journal of the American Medical Informatics Association : JAMIA}
      \field{langid}{english}
      \field{month}{5}
      \field{number}{8}
      \field{title}{Automatic Extraction of Social Determinants of Health from Medical Notes of Chronic Lower Back Pain Patients}
      \field{urlday}{15}
      \field{urlmonth}{11}
      \field{urlyear}{2024}
      \field{volume}{30}
      \field{year}{2023}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \field{pages}{1438}
      \range{pages}{1}
      \verb{doi}
      \verb 10.1093/jamia/ocad054
      \endverb
      \verb{eprint}
      \verb 37080559
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/DI2W4AY8/Lituiev et al. - 2023 - Automatic extraction of social determinants of health from medical notes of chronic lower back pain.pdf
      \endverb
      \verb{urlraw}
      \verb https://pmc.ncbi.nlm.nih.gov/articles/PMC10354762/
      \endverb
      \verb{url}
      \verb https://pmc.ncbi.nlm.nih.gov/articles/PMC10354762/
      \endverb
    \endentry
    \entry{johnsonMIMICIIIFreelyAccessible2016}{article}{}
      \name{author}{10}{}{%
        {{hash=97ddf9ef7b3f83671aa14334972e8186}{%
           family={Johnson},
           familyi={J\bibinitperiod},
           given={Alistair\bibnamedelimb E.\bibnamedelimi W.},
           giveni={A\bibinitperiod\bibinitdelim E\bibinitperiod\bibinitdelim W\bibinitperiod}}}%
        {{hash=b1a10559d1345954860fcb71d58d644b}{%
           family={Pollard},
           familyi={P\bibinitperiod},
           given={Tom\bibnamedelima J.},
           giveni={T\bibinitperiod\bibinitdelim J\bibinitperiod}}}%
        {{hash=905fd330076c29b21add0f3e7108629d}{%
           family={Shen},
           familyi={S\bibinitperiod},
           given={Lu},
           giveni={L\bibinitperiod}}}%
        {{hash=2ea8fc75e44631dccd4c8217117062f2}{%
           family={Lehman},
           familyi={L\bibinitperiod},
           given={Li-wei\bibnamedelima H.},
           giveni={L\bibinithyphendelim w\bibinitperiod\bibinitdelim H\bibinitperiod}}}%
        {{hash=6aa84d1af8a9f95dddedc1677244afbe}{%
           family={Feng},
           familyi={F\bibinitperiod},
           given={Mengling},
           giveni={M\bibinitperiod}}}%
        {{hash=b576d328e9b0f4401d1363e5a30441ac}{%
           family={Ghassemi},
           familyi={G\bibinitperiod},
           given={Mohammad},
           giveni={M\bibinitperiod}}}%
        {{hash=64d84f6b7d6b1cd1b82470cd4f4661b0}{%
           family={Moody},
           familyi={M\bibinitperiod},
           given={Benjamin},
           giveni={B\bibinitperiod}}}%
        {{hash=e4ec701f3e9b3400f41c7dcb84d2e88a}{%
           family={Szolovits},
           familyi={S\bibinitperiod},
           given={Peter},
           giveni={P\bibinitperiod}}}%
        {{hash=f0e3dac1adc983d78b53e594ecb6d1dc}{%
           family={Celi},
           familyi={C\bibinitperiod},
           given={Leo\bibnamedelima Anthony},
           giveni={L\bibinitperiod\bibinitdelim A\bibinitperiod}}}%
        {{hash=2193bac90baddb616fc4dcd2f366de81}{%
           family={Mark},
           familyi={M\bibinitperiod},
           given={Roger\bibnamedelima G.},
           giveni={R\bibinitperiod\bibinitdelim G\bibinitperiod}}}%
      }
      \list{publisher}{1}{%
        {Nature Publishing Group}%
      }
      \strng{namehash}{2dc9d6f36765f978f5cd24a236e1c1e5}
      \strng{fullhash}{924ec116ee95765e276c886e99423344}
      \strng{bibnamehash}{2dc9d6f36765f978f5cd24a236e1c1e5}
      \strng{authorbibnamehash}{2dc9d6f36765f978f5cd24a236e1c1e5}
      \strng{authornamehash}{2dc9d6f36765f978f5cd24a236e1c1e5}
      \strng{authorfullhash}{924ec116ee95765e276c886e99423344}
      \field{sortinit}{3}
      \field{sortinithash}{ad6fe7482ffbd7b9f99c9e8b5dccd3d7}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{abstract}{Design Type(s) data integration objective Measurement Type(s) Demographics • clinical measurement • intervention • Billing • Medical History Dictionary • Pharmacotherapy • clinical laboratory test • medical data Technology Type(s) Electronic Medical Record • Medical Record • Electronic Billing System • Medical Coding Process Document • Free Text Format Factor Type(s) Sample Characteristic(s) Homo sapiens Machine-accessible metadata file describing the reported data (ISA-Tab format)}
      \field{day}{24}
      \field{issn}{2052-4463}
      \field{issue}{1}
      \field{journaltitle}{Scientific Data}
      \field{langid}{english}
      \field{month}{5}
      \field{number}{1}
      \field{shortjournal}{Sci Data}
      \field{title}{{{MIMIC-III}}, a Freely Accessible Critical Care Database}
      \field{urlday}{26}
      \field{urlmonth}{3}
      \field{urlyear}{2020}
      \field{volume}{3}
      \field{year}{2016}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \field{pages}{1\bibrangedash 9}
      \range{pages}{9}
      \verb{doi}
      \verb 10.1038/sdata.2016.35
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/WBQ3WJUN/Johnson et al. - 2016 - MIMIC-III, a freely accessible critical care datab.pdf;/Users/landes/opt/var/zotero/storage/AB7YMAGV/sdata201635.html
      \endverb
      \verb{urlraw}
      \verb https://www.nature.com/articles/sdata201635/
      \endverb
      \verb{url}
      \verb https://www.nature.com/articles/sdata201635/
      \endverb
    \endentry
    \entry{grattafioriLlama3Herd2024}{misc}{}
      \name{author}{561}{}{%
        {{hash=7ac1dd876daaa34de14a8cf2eb49039c}{%
           family={Grattafiori},
           familyi={G\bibinitperiod},
           given={Aaron},
           giveni={A\bibinitperiod}}}%
        {{hash=517ae3236e034cf4fdea5b47025e3973}{%
           family={Dubey},
           familyi={D\bibinitperiod},
           given={Abhimanyu},
           giveni={A\bibinitperiod}}}%
        {{hash=7cd1f80eda1bcdcfef29a10ede4dd146}{%
           family={Jauhri},
           familyi={J\bibinitperiod},
           given={Abhinav},
           giveni={A\bibinitperiod}}}%
        {{hash=06842da7f77ff44040c8321fd64885f3}{%
           family={Pandey},
           familyi={P\bibinitperiod},
           given={Abhinav},
           giveni={A\bibinitperiod}}}%
        {{hash=608d46a077e616c07f7f9f841f4de3ae}{%
           family={Kadian},
           familyi={K\bibinitperiod},
           given={Abhishek},
           giveni={A\bibinitperiod}}}%
        {{hash=2e761a0ae1d9bbf5f560537144813f20}{%
           family={Al-Dahle},
           familyi={A\bibinithyphendelim D\bibinitperiod},
           given={Ahmad},
           giveni={A\bibinitperiod}}}%
        {{hash=1debd101fb9be92bb0eece4c427841d9}{%
           family={Letman},
           familyi={L\bibinitperiod},
           given={Aiesha},
           giveni={A\bibinitperiod}}}%
        {{hash=457cd19c088f0576b2d4d9823277fe38}{%
           family={Mathur},
           familyi={M\bibinitperiod},
           given={Akhil},
           giveni={A\bibinitperiod}}}%
        {{hash=a7fbe7fc6a5ce250cabe9388e690c55b}{%
           family={Schelten},
           familyi={S\bibinitperiod},
           given={Alan},
           giveni={A\bibinitperiod}}}%
        {{hash=6513aec94043b0b10600196df6026a8c}{%
           family={Vaughan},
           familyi={V\bibinitperiod},
           given={Alex},
           giveni={A\bibinitperiod}}}%
        {{hash=d5eae71ab93d6aef82689401f1018de6}{%
           family={Yang},
           familyi={Y\bibinitperiod},
           given={Amy},
           giveni={A\bibinitperiod}}}%
        {{hash=277117db6b938bd36379979ac719cc02}{%
           family={Fan},
           familyi={F\bibinitperiod},
           given={Angela},
           giveni={A\bibinitperiod}}}%
        {{hash=eb6a43771a55bde951c0119ac5c7ad13}{%
           family={Goyal},
           familyi={G\bibinitperiod},
           given={Anirudh},
           giveni={A\bibinitperiod}}}%
        {{hash=83b44b72b8c1a3fa66c344f8314ae0ea}{%
           family={Hartshorn},
           familyi={H\bibinitperiod},
           given={Anthony},
           giveni={A\bibinitperiod}}}%
        {{hash=406e630aa8ec4a134f9d7368afbfba7d}{%
           family={Yang},
           familyi={Y\bibinitperiod},
           given={Aobo},
           giveni={A\bibinitperiod}}}%
        {{hash=9ee5b7c583ffe333cff357d0076583e2}{%
           family={Mitra},
           familyi={M\bibinitperiod},
           given={Archi},
           giveni={A\bibinitperiod}}}%
        {{hash=476c76c4de9ec529afd69122f38f6f2a}{%
           family={Sravankumar},
           familyi={S\bibinitperiod},
           given={Archie},
           giveni={A\bibinitperiod}}}%
        {{hash=897d7f44330ad50e6bbabf2e19436741}{%
           family={Korenev},
           familyi={K\bibinitperiod},
           given={Artem},
           giveni={A\bibinitperiod}}}%
        {{hash=dd42319df6029b8779059366db5bf5a1}{%
           family={Hinsvark},
           familyi={H\bibinitperiod},
           given={Arthur},
           giveni={A\bibinitperiod}}}%
        {{hash=5f597674181132737db0211a957f4dde}{%
           family={Rao},
           familyi={R\bibinitperiod},
           given={Arun},
           giveni={A\bibinitperiod}}}%
        {{hash=983273ab2d972b56d8b64d220726b6aa}{%
           family={Zhang},
           familyi={Z\bibinitperiod},
           given={Aston},
           giveni={A\bibinitperiod}}}%
        {{hash=a829e25f1d50c3545ed8e99f12890acc}{%
           family={Rodriguez},
           familyi={R\bibinitperiod},
           given={Aurelien},
           giveni={A\bibinitperiod}}}%
        {{hash=b2689ee6da3cca0692fb764abee12be3}{%
           family={Gregerson},
           familyi={G\bibinitperiod},
           given={Austen},
           giveni={A\bibinitperiod}}}%
        {{hash=9c93fffb68bf410af913bd94d121f0a9}{%
           family={Spataru},
           familyi={S\bibinitperiod},
           given={Ava},
           giveni={A\bibinitperiod}}}%
        {{hash=5f4e5510fd04af23b103f7b65591a6c1}{%
           family={Roziere},
           familyi={R\bibinitperiod},
           given={Baptiste},
           giveni={B\bibinitperiod}}}%
        {{hash=511a8a03cad821bcb8d968148d173191}{%
           family={Biron},
           familyi={B\bibinitperiod},
           given={Bethany},
           giveni={B\bibinitperiod}}}%
        {{hash=053e8c6174328cafc9566859df3bbe95}{%
           family={Tang},
           familyi={T\bibinitperiod},
           given={Binh},
           giveni={B\bibinitperiod}}}%
        {{hash=1ebb377ae0403a07a7fd272138005880}{%
           family={Chern},
           familyi={C\bibinitperiod},
           given={Bobbie},
           giveni={B\bibinitperiod}}}%
        {{hash=60b0dee36c03f3d79184e3fe4c948885}{%
           family={Caucheteux},
           familyi={C\bibinitperiod},
           given={Charlotte},
           giveni={C\bibinitperiod}}}%
        {{hash=3336eb4e5300d8204ccd75e7b7c6df72}{%
           family={Nayak},
           familyi={N\bibinitperiod},
           given={Chaya},
           giveni={C\bibinitperiod}}}%
        {{hash=e81ac23c5f1addcd3c227114521d590f}{%
           family={Bi},
           familyi={B\bibinitperiod},
           given={Chloe},
           giveni={C\bibinitperiod}}}%
        {{hash=46d5807f87a73a76ecd71aeab5f8bd12}{%
           family={Marra},
           familyi={M\bibinitperiod},
           given={Chris},
           giveni={C\bibinitperiod}}}%
        {{hash=60db036f80713fa213a1b46d1343ab21}{%
           family={McConnell},
           familyi={M\bibinitperiod},
           given={Chris},
           giveni={C\bibinitperiod}}}%
        {{hash=7682db8ac070796c6a652fafec2808c0}{%
           family={Keller},
           familyi={K\bibinitperiod},
           given={Christian},
           giveni={C\bibinitperiod}}}%
        {{hash=9deedad9eadb158dc0b452be1ed5ea8d}{%
           family={Touret},
           familyi={T\bibinitperiod},
           given={Christophe},
           giveni={C\bibinitperiod}}}%
        {{hash=4540e0bc6e94d6172c825c8763ed9ea2}{%
           family={Wu},
           familyi={W\bibinitperiod},
           given={Chunyang},
           giveni={C\bibinitperiod}}}%
        {{hash=d16e7f0423cd1184cb11436b26a1bdaf}{%
           family={Wong},
           familyi={W\bibinitperiod},
           given={Corinne},
           giveni={C\bibinitperiod}}}%
        {{hash=88658b8a76c5ee08e1a06ff9a649912c}{%
           family={Ferrer},
           familyi={F\bibinitperiod},
           given={Cristian\bibnamedelima Canton},
           giveni={C\bibinitperiod\bibinitdelim C\bibinitperiod}}}%
        {{hash=5986b5d4a265702da5b115a74896397b}{%
           family={Nikolaidis},
           familyi={N\bibinitperiod},
           given={Cyrus},
           giveni={C\bibinitperiod}}}%
        {{hash=e55d6988e514e9c72f9fb21f40fb601c}{%
           family={Allonsius},
           familyi={A\bibinitperiod},
           given={Damien},
           giveni={D\bibinitperiod}}}%
        {{hash=55763e73a41d50cc4f9f55a06205cc86}{%
           family={Song},
           familyi={S\bibinitperiod},
           given={Daniel},
           giveni={D\bibinitperiod}}}%
        {{hash=4ed3f3dec5de09d37df1c34480310345}{%
           family={Pintz},
           familyi={P\bibinitperiod},
           given={Danielle},
           giveni={D\bibinitperiod}}}%
        {{hash=96cd5609175a1af286275fdce2035b24}{%
           family={Livshits},
           familyi={L\bibinitperiod},
           given={Danny},
           giveni={D\bibinitperiod}}}%
        {{hash=466c2556f5190f94e1fc1e0e06a9764b}{%
           family={Wyatt},
           familyi={W\bibinitperiod},
           given={Danny},
           giveni={D\bibinitperiod}}}%
        {{hash=8bc68c3d86e021e0a7cf92611aef5aba}{%
           family={Esiobu},
           familyi={E\bibinitperiod},
           given={David},
           giveni={D\bibinitperiod}}}%
        {{hash=43b7c4cd20fa8299528cf96d9b0c15d7}{%
           family={Choudhary},
           familyi={C\bibinitperiod},
           given={Dhruv},
           giveni={D\bibinitperiod}}}%
        {{hash=3a55a24e70b781030f26c1dd27a28d97}{%
           family={Mahajan},
           familyi={M\bibinitperiod},
           given={Dhruv},
           giveni={D\bibinitperiod}}}%
        {{hash=0d327c0fe8637e2c0be9c118c1c6511d}{%
           family={Garcia-Olano},
           familyi={G\bibinithyphendelim O\bibinitperiod},
           given={Diego},
           giveni={D\bibinitperiod}}}%
        {{hash=7ae9cd6ec443d954600e0359962c4bd7}{%
           family={Perino},
           familyi={P\bibinitperiod},
           given={Diego},
           giveni={D\bibinitperiod}}}%
        {{hash=0aab99f9623dcafc949b52e6684d9156}{%
           family={Hupkes},
           familyi={H\bibinitperiod},
           given={Dieuwke},
           giveni={D\bibinitperiod}}}%
        {{hash=dba4865891705cb4d6b9c7a1035dd965}{%
           family={Lakomkin},
           familyi={L\bibinitperiod},
           given={Egor},
           giveni={E\bibinitperiod}}}%
        {{hash=14fd96b159eafa3f79e3845a4c443ee9}{%
           family={AlBadawy},
           familyi={A\bibinitperiod},
           given={Ehab},
           giveni={E\bibinitperiod}}}%
        {{hash=3591ba031dfc34f415377df95ca974e8}{%
           family={Lobanova},
           familyi={L\bibinitperiod},
           given={Elina},
           giveni={E\bibinitperiod}}}%
        {{hash=9d9aa89c5300a6b631bd2c11e1a5ecb5}{%
           family={Dinan},
           familyi={D\bibinitperiod},
           given={Emily},
           giveni={E\bibinitperiod}}}%
        {{hash=d3a381f971b5c6215ca00dbab6af16bc}{%
           family={Smith},
           familyi={S\bibinitperiod},
           given={Eric\bibnamedelima Michael},
           giveni={E\bibinitperiod\bibinitdelim M\bibinitperiod}}}%
        {{hash=c05b7cdee97bbf89a8dcbbc2cba01248}{%
           family={Radenovic},
           familyi={R\bibinitperiod},
           given={Filip},
           giveni={F\bibinitperiod}}}%
        {{hash=f2e3a540fe772c40c15564f8e6056c14}{%
           family={Guzmán},
           familyi={G\bibinitperiod},
           given={Francisco},
           giveni={F\bibinitperiod}}}%
        {{hash=c36fa1678a66294c4e052073505e741f}{%
           family={Zhang},
           familyi={Z\bibinitperiod},
           given={Frank},
           giveni={F\bibinitperiod}}}%
        {{hash=a345e20a460089c920bb74098ed450db}{%
           family={Synnaeve},
           familyi={S\bibinitperiod},
           given={Gabriel},
           giveni={G\bibinitperiod}}}%
        {{hash=446d55de31cf6d76503f570d8d0e1945}{%
           family={Lee},
           familyi={L\bibinitperiod},
           given={Gabrielle},
           giveni={G\bibinitperiod}}}%
        {{hash=d55a7c283d9d7ec492662bd4fb221ce8}{%
           family={Anderson},
           familyi={A\bibinitperiod},
           given={Georgia\bibnamedelima Lewis},
           giveni={G\bibinitperiod\bibinitdelim L\bibinitperiod}}}%
        {{hash=0224eebd162ebf106ab6e6cf381c31f3}{%
           family={Thattai},
           familyi={T\bibinitperiod},
           given={Govind},
           giveni={G\bibinitperiod}}}%
        {{hash=3f24f43e1cf4e0195bd44a1bfbaa7a63}{%
           family={Nail},
           familyi={N\bibinitperiod},
           given={Graeme},
           giveni={G\bibinitperiod}}}%
        {{hash=b8a7ca70cb43965a42b9c6eb0bf53947}{%
           family={Mialon},
           familyi={M\bibinitperiod},
           given={Gregoire},
           giveni={G\bibinitperiod}}}%
        {{hash=5b08b637a3bab8f27d66577f48f39899}{%
           family={Pang},
           familyi={P\bibinitperiod},
           given={Guan},
           giveni={G\bibinitperiod}}}%
        {{hash=0904c97caab4d6e021d459b4326fa0ac}{%
           family={Cucurell},
           familyi={C\bibinitperiod},
           given={Guillem},
           giveni={G\bibinitperiod}}}%
        {{hash=239b8e5169e07c88a99c57cd2ab79bc2}{%
           family={Nguyen},
           familyi={N\bibinitperiod},
           given={Hailey},
           giveni={H\bibinitperiod}}}%
        {{hash=dfba7677fba7e4dc8b94d5c94ee12cfe}{%
           family={Korevaar},
           familyi={K\bibinitperiod},
           given={Hannah},
           giveni={H\bibinitperiod}}}%
        {{hash=e33632a7cd83c6e486ccbe7fd081f315}{%
           family={Xu},
           familyi={X\bibinitperiod},
           given={Hu},
           giveni={H\bibinitperiod}}}%
        {{hash=a2a13fcd633ec70c55a7f3f4812afdcf}{%
           family={Touvron},
           familyi={T\bibinitperiod},
           given={Hugo},
           giveni={H\bibinitperiod}}}%
        {{hash=93956bb0eb985aaa3bc14fd1e311e982}{%
           family={Zarov},
           familyi={Z\bibinitperiod},
           given={Iliyan},
           giveni={I\bibinitperiod}}}%
        {{hash=9671ba761407bb5cd4695fe9f7cada99}{%
           family={Ibarra},
           familyi={I\bibinitperiod},
           given={Imanol\bibnamedelima Arrieta},
           giveni={I\bibinitperiod\bibinitdelim A\bibinitperiod}}}%
        {{hash=ce85bd2d98b3f94c341b59edaa214e3d}{%
           family={Kloumann},
           familyi={K\bibinitperiod},
           given={Isabel},
           giveni={I\bibinitperiod}}}%
        {{hash=4ada721a93e1592ecdc3df0fc9876469}{%
           family={Misra},
           familyi={M\bibinitperiod},
           given={Ishan},
           giveni={I\bibinitperiod}}}%
        {{hash=f9a895918de323357927b1d34c9f157c}{%
           family={Evtimov},
           familyi={E\bibinitperiod},
           given={Ivan},
           giveni={I\bibinitperiod}}}%
        {{hash=559dbff158ab66686ed5993199a83db3}{%
           family={Zhang},
           familyi={Z\bibinitperiod},
           given={Jack},
           giveni={J\bibinitperiod}}}%
        {{hash=754f41410033ef892e9ec8406be562b1}{%
           family={Copet},
           familyi={C\bibinitperiod},
           given={Jade},
           giveni={J\bibinitperiod}}}%
        {{hash=fad5846abebb04ef9424a83e9c98be58}{%
           family={Lee},
           familyi={L\bibinitperiod},
           given={Jaewon},
           giveni={J\bibinitperiod}}}%
        {{hash=783239a28c3499d058b735eae1106637}{%
           family={Geffert},
           familyi={G\bibinitperiod},
           given={Jan},
           giveni={J\bibinitperiod}}}%
        {{hash=c4c153a694c02a74a0a274c73e6441f2}{%
           family={Vranes},
           familyi={V\bibinitperiod},
           given={Jana},
           giveni={J\bibinitperiod}}}%
        {{hash=dac470c32dedad932ab1af9c3260bb72}{%
           family={Park},
           familyi={P\bibinitperiod},
           given={Jason},
           giveni={J\bibinitperiod}}}%
        {{hash=9a1db2f2823684340e000e50c6208a1f}{%
           family={Mahadeokar},
           familyi={M\bibinitperiod},
           given={Jay},
           giveni={J\bibinitperiod}}}%
        {{hash=aeee6e510ec84f70732dea374d8a5ed2}{%
           family={Shah},
           familyi={S\bibinitperiod},
           given={Jeet},
           giveni={J\bibinitperiod}}}%
        {{hash=99f3ebed2f6b73f262331b1ad545a6df}{%
           family={Linde},
           familyi={L\bibinitperiod},
           given={Jelmer},
           giveni={J\bibinitperiod},
           prefix={van\bibnamedelima der},
           prefixi={v\bibinitperiod\bibinitdelim d\bibinitperiod}}}%
        {{hash=8addaf2119b976c360fac666e552339d}{%
           family={Billock},
           familyi={B\bibinitperiod},
           given={Jennifer},
           giveni={J\bibinitperiod}}}%
        {{hash=faf318ef4acda4567253c563b330f7ff}{%
           family={Hong},
           familyi={H\bibinitperiod},
           given={Jenny},
           giveni={J\bibinitperiod}}}%
        {{hash=6ce116cb36b1ac6aa9dd9ea8b552ea39}{%
           family={Lee},
           familyi={L\bibinitperiod},
           given={Jenya},
           giveni={J\bibinitperiod}}}%
        {{hash=76c6af62ff4da9d3f19d41b4e8d2bbc1}{%
           family={Fu},
           familyi={F\bibinitperiod},
           given={Jeremy},
           giveni={J\bibinitperiod}}}%
        {{hash=3a14f76bc40e8aa0a4eccb67be887f86}{%
           family={Chi},
           familyi={C\bibinitperiod},
           given={Jianfeng},
           giveni={J\bibinitperiod}}}%
        {{hash=4d5dd7060b67c3b1f62b82e0dea2a4e0}{%
           family={Huang},
           familyi={H\bibinitperiod},
           given={Jianyu},
           giveni={J\bibinitperiod}}}%
        {{hash=451d91a5bd40575b8fa58bfe8d336090}{%
           family={Liu},
           familyi={L\bibinitperiod},
           given={Jiawen},
           giveni={J\bibinitperiod}}}%
        {{hash=fcd6114a30fda9801eef65b9d374f56b}{%
           family={Wang},
           familyi={W\bibinitperiod},
           given={Jie},
           giveni={J\bibinitperiod}}}%
        {{hash=aefd0dd76e8ae7b871a4bea7623fe602}{%
           family={Yu},
           familyi={Y\bibinitperiod},
           given={Jiecao},
           giveni={J\bibinitperiod}}}%
        {{hash=2a689adc56bc1cd7ef1a5d47c4f2a1c2}{%
           family={Bitton},
           familyi={B\bibinitperiod},
           given={Joanna},
           giveni={J\bibinitperiod}}}%
        {{hash=4a27a3fc7c2e8cf8a844a8ecd54e919d}{%
           family={Spisak},
           familyi={S\bibinitperiod},
           given={Joe},
           giveni={J\bibinitperiod}}}%
        {{hash=d453b06ade17d41da4d373ecf988e52a}{%
           family={Park},
           familyi={P\bibinitperiod},
           given={Jongsoo},
           giveni={J\bibinitperiod}}}%
        {{hash=6aaaea242a73e6eea97578d681468442}{%
           family={Rocca},
           familyi={R\bibinitperiod},
           given={Joseph},
           giveni={J\bibinitperiod}}}%
        {{hash=ca81589cf7cac022f06650385c8b9d05}{%
           family={Johnstun},
           familyi={J\bibinitperiod},
           given={Joshua},
           giveni={J\bibinitperiod}}}%
        {{hash=ebddaeb491ec309604315869c03f5fb6}{%
           family={Saxe},
           familyi={S\bibinitperiod},
           given={Joshua},
           giveni={J\bibinitperiod}}}%
        {{hash=0fdda3217c25f869c66e0f1f0a9816b6}{%
           family={Jia},
           familyi={J\bibinitperiod},
           given={Junteng},
           giveni={J\bibinitperiod}}}%
        {{hash=dbea60af0097d26182dbc78d209e116e}{%
           family={Alwala},
           familyi={A\bibinitperiod},
           given={Kalyan\bibnamedelima Vasuden},
           giveni={K\bibinitperiod\bibinitdelim V\bibinitperiod}}}%
        {{hash=ff03033f89dcfb6e7f181829c584da48}{%
           family={Prasad},
           familyi={P\bibinitperiod},
           given={Karthik},
           giveni={K\bibinitperiod}}}%
        {{hash=02100c17b9904b7c4bf7845fcdf39e55}{%
           family={Upasani},
           familyi={U\bibinitperiod},
           given={Kartikeya},
           giveni={K\bibinitperiod}}}%
        {{hash=36190f678d0db058f91c0fa98d8c2226}{%
           family={Plawiak},
           familyi={P\bibinitperiod},
           given={Kate},
           giveni={K\bibinitperiod}}}%
        {{hash=815a2cdb03036dc2884fcf0472f759cf}{%
           family={Li},
           familyi={L\bibinitperiod},
           given={Ke},
           giveni={K\bibinitperiod}}}%
        {{hash=7335b523d68241b7785091b15c243eac}{%
           family={Heafield},
           familyi={H\bibinitperiod},
           given={Kenneth},
           giveni={K\bibinitperiod}}}%
        {{hash=2f7a28226c3a07d546eb4e727221d2ea}{%
           family={Stone},
           familyi={S\bibinitperiod},
           given={Kevin},
           giveni={K\bibinitperiod}}}%
        {{hash=f83b63a652208c1987868f7712047515}{%
           family={El-Arini},
           familyi={E\bibinithyphendelim A\bibinitperiod},
           given={Khalid},
           giveni={K\bibinitperiod}}}%
        {{hash=3ece0bb6da8d30142a3ff3bce0ff6dc9}{%
           family={Iyer},
           familyi={I\bibinitperiod},
           given={Krithika},
           giveni={K\bibinitperiod}}}%
        {{hash=d2a4ed88a068eabe32304fe58d6e038d}{%
           family={Malik},
           familyi={M\bibinitperiod},
           given={Kshitiz},
           giveni={K\bibinitperiod}}}%
        {{hash=ce78cb6b0c60fa398802dc90a821d318}{%
           family={Chiu},
           familyi={C\bibinitperiod},
           given={Kuenley},
           giveni={K\bibinitperiod}}}%
        {{hash=d8c5cf85374627a5b508c28ec50a61da}{%
           family={Bhalla},
           familyi={B\bibinitperiod},
           given={Kunal},
           giveni={K\bibinitperiod}}}%
        {{hash=90da1abde84b45ee8f620c681a9f2088}{%
           family={Lakhotia},
           familyi={L\bibinitperiod},
           given={Kushal},
           giveni={K\bibinitperiod}}}%
        {{hash=ae95a269f6462af93a8a4e29f0c4c354}{%
           family={Rantala-Yeary},
           familyi={R\bibinithyphendelim Y\bibinitperiod},
           given={Lauren},
           giveni={L\bibinitperiod}}}%
        {{hash=47fbe2837893a84fb516e9e85ba7aa36}{%
           family={Maaten},
           familyi={M\bibinitperiod},
           given={Laurens},
           giveni={L\bibinitperiod},
           prefix={van\bibnamedelima der},
           prefixi={v\bibinitperiod\bibinitdelim d\bibinitperiod}}}%
        {{hash=090a9901d02a0452a90109efa1f31cc7}{%
           family={Chen},
           familyi={C\bibinitperiod},
           given={Lawrence},
           giveni={L\bibinitperiod}}}%
        {{hash=74dd8d145e8762841eba435fa00a9a37}{%
           family={Tan},
           familyi={T\bibinitperiod},
           given={Liang},
           giveni={L\bibinitperiod}}}%
        {{hash=93c5fa87a0065c89150edba624a9d4b4}{%
           family={Jenkins},
           familyi={J\bibinitperiod},
           given={Liz},
           giveni={L\bibinitperiod}}}%
        {{hash=950630d7ca7a0fad0a3d3f705e279eb1}{%
           family={Martin},
           familyi={M\bibinitperiod},
           given={Louis},
           giveni={L\bibinitperiod}}}%
        {{hash=bfecac3687aa510dc501bd584aebd14c}{%
           family={Madaan},
           familyi={M\bibinitperiod},
           given={Lovish},
           giveni={L\bibinitperiod}}}%
        {{hash=6b4ecfbce0b2f5421fca855200ce8402}{%
           family={Malo},
           familyi={M\bibinitperiod},
           given={Lubo},
           giveni={L\bibinitperiod}}}%
        {{hash=8269ea0da45e06632fa2fb6ab5a485f2}{%
           family={Blecher},
           familyi={B\bibinitperiod},
           given={Lukas},
           giveni={L\bibinitperiod}}}%
        {{hash=1d1a22fbe4ec5623497a35cc6b461e93}{%
           family={Landzaat},
           familyi={L\bibinitperiod},
           given={Lukas},
           giveni={L\bibinitperiod}}}%
        {{hash=6716e1a7ecf5c53811aca15e30b84ef1}{%
           family={Oliveira},
           familyi={O\bibinitperiod},
           given={Luke},
           giveni={L\bibinitperiod},
           prefix={de},
           prefixi={d\bibinitperiod}}}%
        {{hash=56b5b1736e48384ef7756cfaa4882fad}{%
           family={Muzzi},
           familyi={M\bibinitperiod},
           given={Madeline},
           giveni={M\bibinitperiod}}}%
        {{hash=d20dbd6636782c062f2caeb8df352784}{%
           family={Pasupuleti},
           familyi={P\bibinitperiod},
           given={Mahesh},
           giveni={M\bibinitperiod}}}%
        {{hash=f0a4c8dfbb53049c09141b32643288b2}{%
           family={Singh},
           familyi={S\bibinitperiod},
           given={Mannat},
           giveni={M\bibinitperiod}}}%
        {{hash=d1976e858e503a89ab7e5fa48734c939}{%
           family={Paluri},
           familyi={P\bibinitperiod},
           given={Manohar},
           giveni={M\bibinitperiod}}}%
        {{hash=71cb443347f4b9392a81d58940afc147}{%
           family={Kardas},
           familyi={K\bibinitperiod},
           given={Marcin},
           giveni={M\bibinitperiod}}}%
        {{hash=69e7c09505863223949fcb52b5d05d89}{%
           family={Tsimpoukelli},
           familyi={T\bibinitperiod},
           given={Maria},
           giveni={M\bibinitperiod}}}%
        {{hash=4cbcb22a60be8a2dea4f6acbcde8bc01}{%
           family={Oldham},
           familyi={O\bibinitperiod},
           given={Mathew},
           giveni={M\bibinitperiod}}}%
        {{hash=e5ce0679abfc2a97fd3e295186868818}{%
           family={Rita},
           familyi={R\bibinitperiod},
           given={Mathieu},
           giveni={M\bibinitperiod}}}%
        {{hash=0afa85890f0145d06e829a82d73ca0df}{%
           family={Pavlova},
           familyi={P\bibinitperiod},
           given={Maya},
           giveni={M\bibinitperiod}}}%
        {{hash=54affa9a2c21ec7e6165e1f0698417b1}{%
           family={Kambadur},
           familyi={K\bibinitperiod},
           given={Melanie},
           giveni={M\bibinitperiod}}}%
        {{hash=c97f53fdeeb04c28de19e3324cb4bc0a}{%
           family={Lewis},
           familyi={L\bibinitperiod},
           given={Mike},
           giveni={M\bibinitperiod}}}%
        {{hash=b2e053cdeb5efd4efc0a937b2925612c}{%
           family={Si},
           familyi={S\bibinitperiod},
           given={Min},
           giveni={M\bibinitperiod}}}%
        {{hash=8d01d4af1462d03d8e7b4d180b0034ff}{%
           family={Singh},
           familyi={S\bibinitperiod},
           given={Mitesh\bibnamedelima Kumar},
           giveni={M\bibinitperiod\bibinitdelim K\bibinitperiod}}}%
        {{hash=92aac3ec505dd813ea2ddd0b1a3841e6}{%
           family={Hassan},
           familyi={H\bibinitperiod},
           given={Mona},
           giveni={M\bibinitperiod}}}%
        {{hash=78a420900f50a8470ad085fb05231bf6}{%
           family={Goyal},
           familyi={G\bibinitperiod},
           given={Naman},
           giveni={N\bibinitperiod}}}%
        {{hash=c5e5ae63a4f015ffa0d6a6f773f988c7}{%
           family={Torabi},
           familyi={T\bibinitperiod},
           given={Narjes},
           giveni={N\bibinitperiod}}}%
        {{hash=8dca70cf10dd8f894b4dff4af9ff238c}{%
           family={Bashlykov},
           familyi={B\bibinitperiod},
           given={Nikolay},
           giveni={N\bibinitperiod}}}%
        {{hash=d58110a310cacc94692f0f5b6dd202ed}{%
           family={Bogoychev},
           familyi={B\bibinitperiod},
           given={Nikolay},
           giveni={N\bibinitperiod}}}%
        {{hash=ef6ded1d36f3b5b10bb5f2447bc40818}{%
           family={Chatterji},
           familyi={C\bibinitperiod},
           given={Niladri},
           giveni={N\bibinitperiod}}}%
        {{hash=803fb0c7ba592ff2ac5109218a4a8211}{%
           family={Zhang},
           familyi={Z\bibinitperiod},
           given={Ning},
           giveni={N\bibinitperiod}}}%
        {{hash=f9c5d2c162690076b15de314a8215961}{%
           family={Duchenne},
           familyi={D\bibinitperiod},
           given={Olivier},
           giveni={O\bibinitperiod}}}%
        {{hash=b50226f3de19ee635922d59edd7ae7e5}{%
           family={Çelebi},
           familyi={Ç\bibinitperiod},
           given={Onur},
           giveni={O\bibinitperiod}}}%
        {{hash=798fef5b4c3e0906b43971fc37795f81}{%
           family={Alrassy},
           familyi={A\bibinitperiod},
           given={Patrick},
           giveni={P\bibinitperiod}}}%
        {{hash=6e8ae7560608b7727418a49a752bbe2f}{%
           family={Zhang},
           familyi={Z\bibinitperiod},
           given={Pengchuan},
           giveni={P\bibinitperiod}}}%
        {{hash=053d099671dbc892fb57a5464fe99862}{%
           family={Li},
           familyi={L\bibinitperiod},
           given={Pengwei},
           giveni={P\bibinitperiod}}}%
        {{hash=4e5b76c778a7d65b18700c12f33efa62}{%
           family={Vasic},
           familyi={V\bibinitperiod},
           given={Petar},
           giveni={P\bibinitperiod}}}%
        {{hash=e190d2d85cfe549644d9d4270cf3c193}{%
           family={Weng},
           familyi={W\bibinitperiod},
           given={Peter},
           giveni={P\bibinitperiod}}}%
        {{hash=f6126d401371bb053d15e54678a5d2be}{%
           family={Bhargava},
           familyi={B\bibinitperiod},
           given={Prajjwal},
           giveni={P\bibinitperiod}}}%
        {{hash=b2ca9905acb96c0dd1b36c24148fc07e}{%
           family={Dubal},
           familyi={D\bibinitperiod},
           given={Pratik},
           giveni={P\bibinitperiod}}}%
        {{hash=837a8f1fd024a33720a1ba69b40a2dc0}{%
           family={Krishnan},
           familyi={K\bibinitperiod},
           given={Praveen},
           giveni={P\bibinitperiod}}}%
        {{hash=b58bfbc914fead2ccb6bc50a44bbe36f}{%
           family={Koura},
           familyi={K\bibinitperiod},
           given={Punit\bibnamedelima Singh},
           giveni={P\bibinitperiod\bibinitdelim S\bibinitperiod}}}%
        {{hash=45be0856419ed489bdf51603a27cf854}{%
           family={Xu},
           familyi={X\bibinitperiod},
           given={Puxin},
           giveni={P\bibinitperiod}}}%
        {{hash=7c27f1b2b48feefb0593a05e9c6a8b12}{%
           family={He},
           familyi={H\bibinitperiod},
           given={Qing},
           giveni={Q\bibinitperiod}}}%
        {{hash=13993f1539efb56c308bc5396bf5b0f4}{%
           family={Dong},
           familyi={D\bibinitperiod},
           given={Qingxiao},
           giveni={Q\bibinitperiod}}}%
        {{hash=439acb42a33468f60e368e4c9b5bb4ed}{%
           family={Srinivasan},
           familyi={S\bibinitperiod},
           given={Ragavan},
           giveni={R\bibinitperiod}}}%
        {{hash=7588dba48927dee26ecc709c9167169e}{%
           family={Ganapathy},
           familyi={G\bibinitperiod},
           given={Raj},
           giveni={R\bibinitperiod}}}%
        {{hash=329dcc3352aaa5053bed2565ff100e10}{%
           family={Calderer},
           familyi={C\bibinitperiod},
           given={Ramon},
           giveni={R\bibinitperiod}}}%
        {{hash=aee7d69c56b580e9bedc7fefc9eb9c52}{%
           family={Cabral},
           familyi={C\bibinitperiod},
           given={Ricardo\bibnamedelima Silveira},
           giveni={R\bibinitperiod\bibinitdelim S\bibinitperiod}}}%
        {{hash=5f64b32e164398414aabe27f1af0140e}{%
           family={Stojnic},
           familyi={S\bibinitperiod},
           given={Robert},
           giveni={R\bibinitperiod}}}%
        {{hash=6f4fcbeef9e0ff74d528e953d5c5f6c7}{%
           family={Raileanu},
           familyi={R\bibinitperiod},
           given={Roberta},
           giveni={R\bibinitperiod}}}%
        {{hash=f62a5cd724856f655b3ec8948b158fbf}{%
           family={Maheswari},
           familyi={M\bibinitperiod},
           given={Rohan},
           giveni={R\bibinitperiod}}}%
        {{hash=b04a9f34a16019be789d119ecef9ae8b}{%
           family={Girdhar},
           familyi={G\bibinitperiod},
           given={Rohit},
           giveni={R\bibinitperiod}}}%
        {{hash=b76c0872b581774230eafe330e0f948d}{%
           family={Patel},
           familyi={P\bibinitperiod},
           given={Rohit},
           giveni={R\bibinitperiod}}}%
        {{hash=8e33aea10f45b2bc5ebe66bc7fdbcab7}{%
           family={Sauvestre},
           familyi={S\bibinitperiod},
           given={Romain},
           giveni={R\bibinitperiod}}}%
        {{hash=249caeb243804ab63be7b727ecf9f0b3}{%
           family={Polidoro},
           familyi={P\bibinitperiod},
           given={Ronnie},
           giveni={R\bibinitperiod}}}%
        {{hash=2407ed6a0925d80f5c31039222182737}{%
           family={Sumbaly},
           familyi={S\bibinitperiod},
           given={Roshan},
           giveni={R\bibinitperiod}}}%
        {{hash=bc3d70abe301dce69ed52a2854aabd09}{%
           family={Taylor},
           familyi={T\bibinitperiod},
           given={Ross},
           giveni={R\bibinitperiod}}}%
        {{hash=890ca1d1a899ca554e599fcb6e7fb479}{%
           family={Silva},
           familyi={S\bibinitperiod},
           given={Ruan},
           giveni={R\bibinitperiod}}}%
        {{hash=87e1cd3cb3c64f79a269f8eb6ca4689c}{%
           family={Hou},
           familyi={H\bibinitperiod},
           given={Rui},
           giveni={R\bibinitperiod}}}%
        {{hash=9a8e37c2db183faff113a94a5dbc4914}{%
           family={Wang},
           familyi={W\bibinitperiod},
           given={Rui},
           giveni={R\bibinitperiod}}}%
        {{hash=4abc1e75d2af9ab7d913201989a0e571}{%
           family={Hosseini},
           familyi={H\bibinitperiod},
           given={Saghar},
           giveni={S\bibinitperiod}}}%
        {{hash=01bfc925489a1aa0b42bbccd3a1b910d}{%
           family={Chennabasappa},
           familyi={C\bibinitperiod},
           given={Sahana},
           giveni={S\bibinitperiod}}}%
        {{hash=f6f98d9855931a1b4a26f28c431c896c}{%
           family={Singh},
           familyi={S\bibinitperiod},
           given={Sanjay},
           giveni={S\bibinitperiod}}}%
        {{hash=66430b8659a566bd0a6f426873ec981a}{%
           family={Bell},
           familyi={B\bibinitperiod},
           given={Sean},
           giveni={S\bibinitperiod}}}%
        {{hash=17805ef7508734c22d008d0042164d91}{%
           family={Kim},
           familyi={K\bibinitperiod},
           given={Seohyun\bibnamedelima Sonia},
           giveni={S\bibinitperiod\bibinitdelim S\bibinitperiod}}}%
        {{hash=79caf76234e835df3dc38a785e0913e0}{%
           family={Edunov},
           familyi={E\bibinitperiod},
           given={Sergey},
           giveni={S\bibinitperiod}}}%
        {{hash=0d41a9b721eb8bfd6c1060b3a974cdbe}{%
           family={Nie},
           familyi={N\bibinitperiod},
           given={Shaoliang},
           giveni={S\bibinitperiod}}}%
        {{hash=a2da348cbbad750c6fe76dda9c35ffcd}{%
           family={Narang},
           familyi={N\bibinitperiod},
           given={Sharan},
           giveni={S\bibinitperiod}}}%
        {{hash=f46bde2b73f64feac494d54df17a56cd}{%
           family={Raparthy},
           familyi={R\bibinitperiod},
           given={Sharath},
           giveni={S\bibinitperiod}}}%
        {{hash=0e8faef8660b332360bc58caaa793303}{%
           family={Shen},
           familyi={S\bibinitperiod},
           given={Sheng},
           giveni={S\bibinitperiod}}}%
        {{hash=2980de2259ff3bfd7c43b05073509045}{%
           family={Wan},
           familyi={W\bibinitperiod},
           given={Shengye},
           giveni={S\bibinitperiod}}}%
        {{hash=7681ed73d0f254dc4ce489faa0245a38}{%
           family={Bhosale},
           familyi={B\bibinitperiod},
           given={Shruti},
           giveni={S\bibinitperiod}}}%
        {{hash=a3739bbe1787246c16692bfb043543a2}{%
           family={Zhang},
           familyi={Z\bibinitperiod},
           given={Shun},
           giveni={S\bibinitperiod}}}%
        {{hash=8366514841cca3b7ed038c0422a0177f}{%
           family={Vandenhende},
           familyi={V\bibinitperiod},
           given={Simon},
           giveni={S\bibinitperiod}}}%
        {{hash=1b9611b3526fa975cb70666e43061068}{%
           family={Batra},
           familyi={B\bibinitperiod},
           given={Soumya},
           giveni={S\bibinitperiod}}}%
        {{hash=957f76287a021b9d8a0a3ad11b2b2e22}{%
           family={Whitman},
           familyi={W\bibinitperiod},
           given={Spencer},
           giveni={S\bibinitperiod}}}%
        {{hash=6bf726fdc870ddfdcb98122f0f9e7422}{%
           family={Sootla},
           familyi={S\bibinitperiod},
           given={Sten},
           giveni={S\bibinitperiod}}}%
        {{hash=4b86bc07b579ac8c2921000e01f27a80}{%
           family={Collot},
           familyi={C\bibinitperiod},
           given={Stephane},
           giveni={S\bibinitperiod}}}%
        {{hash=d1d3c4c5376249f5a5ed8c43c6585e47}{%
           family={Gururangan},
           familyi={G\bibinitperiod},
           given={Suchin},
           giveni={S\bibinitperiod}}}%
        {{hash=824d6e2c49ec949550246a2ea57a743e}{%
           family={Borodinsky},
           familyi={B\bibinitperiod},
           given={Sydney},
           giveni={S\bibinitperiod}}}%
        {{hash=b0a9bd1317ecd31e7a0bf07e018aca1e}{%
           family={Herman},
           familyi={H\bibinitperiod},
           given={Tamar},
           giveni={T\bibinitperiod}}}%
        {{hash=51f4beece23d913bedabfbe65082e9b2}{%
           family={Fowler},
           familyi={F\bibinitperiod},
           given={Tara},
           giveni={T\bibinitperiod}}}%
        {{hash=d9cd0f1b7f1372adec7ab0cf7b63a5f1}{%
           family={Sheasha},
           familyi={S\bibinitperiod},
           given={Tarek},
           giveni={T\bibinitperiod}}}%
        {{hash=55899b1834a47e42e0d2d9e15f4fa5e8}{%
           family={Georgiou},
           familyi={G\bibinitperiod},
           given={Thomas},
           giveni={T\bibinitperiod}}}%
        {{hash=3669dc61c228df3d7b95b1306107fa82}{%
           family={Scialom},
           familyi={S\bibinitperiod},
           given={Thomas},
           giveni={T\bibinitperiod}}}%
        {{hash=db801b929045385e0278353141905b77}{%
           family={Speckbacher},
           familyi={S\bibinitperiod},
           given={Tobias},
           giveni={T\bibinitperiod}}}%
        {{hash=2760810ac53a3b0afd0d63a8af2b52e3}{%
           family={Mihaylov},
           familyi={M\bibinitperiod},
           given={Todor},
           giveni={T\bibinitperiod}}}%
        {{hash=41028368e6169b6177f4b66947f5eed0}{%
           family={Xiao},
           familyi={X\bibinitperiod},
           given={Tong},
           giveni={T\bibinitperiod}}}%
        {{hash=985c4475f1e55e59f7bd68f5ac293c6b}{%
           family={Karn},
           familyi={K\bibinitperiod},
           given={Ujjwal},
           giveni={U\bibinitperiod}}}%
        {{hash=3b3711fab2634fac4eff6816c0f5cb0c}{%
           family={Goswami},
           familyi={G\bibinitperiod},
           given={Vedanuj},
           giveni={V\bibinitperiod}}}%
        {{hash=4d2a9682f134773155ee92056a02000a}{%
           family={Gupta},
           familyi={G\bibinitperiod},
           given={Vibhor},
           giveni={V\bibinitperiod}}}%
        {{hash=98b5373cace5e2cae4451d8e1ab0f2a6}{%
           family={Ramanathan},
           familyi={R\bibinitperiod},
           given={Vignesh},
           giveni={V\bibinitperiod}}}%
        {{hash=8406b239af8c6ae9ab411887b09b8cdd}{%
           family={Kerkez},
           familyi={K\bibinitperiod},
           given={Viktor},
           giveni={V\bibinitperiod}}}%
        {{hash=731e41af12131339812a2e1d2fd4264b}{%
           family={Gonguet},
           familyi={G\bibinitperiod},
           given={Vincent},
           giveni={V\bibinitperiod}}}%
        {{hash=385be234eecddfc0f46e562565e0e8d2}{%
           family={Do},
           familyi={D\bibinitperiod},
           given={Virginie},
           giveni={V\bibinitperiod}}}%
        {{hash=456bbb7e40bd87c238fd46331abc4852}{%
           family={Vogeti},
           familyi={V\bibinitperiod},
           given={Vish},
           giveni={V\bibinitperiod}}}%
        {{hash=3de5b6c6ed631b76658ed2f0a0c8c56e}{%
           family={Albiero},
           familyi={A\bibinitperiod},
           given={Vítor},
           giveni={V\bibinitperiod}}}%
        {{hash=03f1f84e19c0effe98205ab9a4d71724}{%
           family={Petrovic},
           familyi={P\bibinitperiod},
           given={Vladan},
           giveni={V\bibinitperiod}}}%
        {{hash=ae16043bc735d2e68fd2f2048a261cb0}{%
           family={Chu},
           familyi={C\bibinitperiod},
           given={Weiwei},
           giveni={W\bibinitperiod}}}%
        {{hash=ebf728d4edd3772aa46233df8265003e}{%
           family={Xiong},
           familyi={X\bibinitperiod},
           given={Wenhan},
           giveni={W\bibinitperiod}}}%
        {{hash=c206969fdfb0e87b34f30ee6cc0f0139}{%
           family={Fu},
           familyi={F\bibinitperiod},
           given={Wenyin},
           giveni={W\bibinitperiod}}}%
        {{hash=0dca8ecf486ac7cf75fdac6bef569a8b}{%
           family={Meers},
           familyi={M\bibinitperiod},
           given={Whitney},
           giveni={W\bibinitperiod}}}%
        {{hash=7222f9d76b0fff504f39e7c9c2a526be}{%
           family={Martinet},
           familyi={M\bibinitperiod},
           given={Xavier},
           giveni={X\bibinitperiod}}}%
        {{hash=cd26424dac955ebe267f1a2f0325d9f3}{%
           family={Wang},
           familyi={W\bibinitperiod},
           given={Xiaodong},
           giveni={X\bibinitperiod}}}%
        {{hash=e36ef4c933b18c6fa38007e1c522dde6}{%
           family={Wang},
           familyi={W\bibinitperiod},
           given={Xiaofang},
           giveni={X\bibinitperiod}}}%
        {{hash=9cf8d901d24d77adab28b880dc77fbde}{%
           family={Tan},
           familyi={T\bibinitperiod},
           given={Xiaoqing\bibnamedelima Ellen},
           giveni={X\bibinitperiod\bibinitdelim E\bibinitperiod}}}%
        {{hash=317b463e486d5ad69936294c6db717ff}{%
           family={Xia},
           familyi={X\bibinitperiod},
           given={Xide},
           giveni={X\bibinitperiod}}}%
        {{hash=171702d62eddf18f37fcdb07dd3cc38f}{%
           family={Xie},
           familyi={X\bibinitperiod},
           given={Xinfeng},
           giveni={X\bibinitperiod}}}%
        {{hash=7778cc0a3ceb7bc7d21da689ccbacadd}{%
           family={Jia},
           familyi={J\bibinitperiod},
           given={Xuchao},
           giveni={X\bibinitperiod}}}%
        {{hash=aca8c393efd61cde9155d6edae887bcc}{%
           family={Wang},
           familyi={W\bibinitperiod},
           given={Xuewei},
           giveni={X\bibinitperiod}}}%
        {{hash=fdb54ac249abf18859648480c419bf0f}{%
           family={Goldschlag},
           familyi={G\bibinitperiod},
           given={Yaelle},
           giveni={Y\bibinitperiod}}}%
        {{hash=d0815b5d48e41b65855ec469e3546971}{%
           family={Gaur},
           familyi={G\bibinitperiod},
           given={Yashesh},
           giveni={Y\bibinitperiod}}}%
        {{hash=3f8d04c034a513f6abe1e2c15f14e3e4}{%
           family={Babaei},
           familyi={B\bibinitperiod},
           given={Yasmine},
           giveni={Y\bibinitperiod}}}%
        {{hash=a64d15774d6fc7b1171ced403cea68c3}{%
           family={Wen},
           familyi={W\bibinitperiod},
           given={Yi},
           giveni={Y\bibinitperiod}}}%
        {{hash=9bd32de2762a7622190cdc86304f6b18}{%
           family={Song},
           familyi={S\bibinitperiod},
           given={Yiwen},
           giveni={Y\bibinitperiod}}}%
        {{hash=584fe8cb46f9a24597f46045f82d1d8d}{%
           family={Zhang},
           familyi={Z\bibinitperiod},
           given={Yuchen},
           giveni={Y\bibinitperiod}}}%
        {{hash=0e1dff109644a2423d611a0bfe123178}{%
           family={Li},
           familyi={L\bibinitperiod},
           given={Yue},
           giveni={Y\bibinitperiod}}}%
        {{hash=4bf12306f229966567f3fa80a61f52c9}{%
           family={Mao},
           familyi={M\bibinitperiod},
           given={Yuning},
           giveni={Y\bibinitperiod}}}%
        {{hash=5d127fc68c862ac6acbaf194dd5341b3}{%
           family={Coudert},
           familyi={C\bibinitperiod},
           given={Zacharie\bibnamedelima Delpierre},
           giveni={Z\bibinitperiod\bibinitdelim D\bibinitperiod}}}%
        {{hash=d2ade1cc491ab061c743877b9fac6eb4}{%
           family={Yan},
           familyi={Y\bibinitperiod},
           given={Zheng},
           giveni={Z\bibinitperiod}}}%
        {{hash=c2e101fe9820cc9ebb5a6d51ebdff69f}{%
           family={Chen},
           familyi={C\bibinitperiod},
           given={Zhengxing},
           giveni={Z\bibinitperiod}}}%
        {{hash=924298ff0f42916eefd4612747b69168}{%
           family={Papakipos},
           familyi={P\bibinitperiod},
           given={Zoe},
           giveni={Z\bibinitperiod}}}%
        {{hash=3f3a905d16e64c5f11efab25a0da6255}{%
           family={Singh},
           familyi={S\bibinitperiod},
           given={Aaditya},
           giveni={A\bibinitperiod}}}%
        {{hash=d6b12b852f546c335b59d4a6703198b2}{%
           family={Srivastava},
           familyi={S\bibinitperiod},
           given={Aayushi},
           giveni={A\bibinitperiod}}}%
        {{hash=0dd18c09e0af266292d5a7e9a2accff3}{%
           family={Jain},
           familyi={J\bibinitperiod},
           given={Abha},
           giveni={A\bibinitperiod}}}%
        {{hash=c56eec940be89868eed50f123204dec0}{%
           family={Kelsey},
           familyi={K\bibinitperiod},
           given={Adam},
           giveni={A\bibinitperiod}}}%
        {{hash=dde1a2384f95b935aa2b55975ed2b3f6}{%
           family={Shajnfeld},
           familyi={S\bibinitperiod},
           given={Adam},
           giveni={A\bibinitperiod}}}%
        {{hash=4b7ae8b3b746745e1d3cadafc45ffb3e}{%
           family={Gangidi},
           familyi={G\bibinitperiod},
           given={Adithya},
           giveni={A\bibinitperiod}}}%
        {{hash=1aa5a110a6957624dd943b795f0af71d}{%
           family={Victoria},
           familyi={V\bibinitperiod},
           given={Adolfo},
           giveni={A\bibinitperiod}}}%
        {{hash=7b4fa10f252f1324eda28c7c5b71efda}{%
           family={Goldstand},
           familyi={G\bibinitperiod},
           given={Ahuva},
           giveni={A\bibinitperiod}}}%
        {{hash=70c4067ccb121ce9d1346cfc7c622279}{%
           family={Menon},
           familyi={M\bibinitperiod},
           given={Ajay},
           giveni={A\bibinitperiod}}}%
        {{hash=e9a4763f65102abab18661133f199010}{%
           family={Sharma},
           familyi={S\bibinitperiod},
           given={Ajay},
           giveni={A\bibinitperiod}}}%
        {{hash=a1f74b7b2d93ac9f180664f3ce1176f6}{%
           family={Boesenberg},
           familyi={B\bibinitperiod},
           given={Alex},
           giveni={A\bibinitperiod}}}%
        {{hash=e478046d4abc39e9814f6e364a736511}{%
           family={Baevski},
           familyi={B\bibinitperiod},
           given={Alexei},
           giveni={A\bibinitperiod}}}%
        {{hash=2e4283faf5715d7621de875320480ded}{%
           family={Feinstein},
           familyi={F\bibinitperiod},
           given={Allie},
           giveni={A\bibinitperiod}}}%
        {{hash=d5cd1376c5170b4a2fa1a09ab2d87a95}{%
           family={Kallet},
           familyi={K\bibinitperiod},
           given={Amanda},
           giveni={A\bibinitperiod}}}%
        {{hash=e9cb262adced7bca6f31d1a1294f0604}{%
           family={Sangani},
           familyi={S\bibinitperiod},
           given={Amit},
           giveni={A\bibinitperiod}}}%
        {{hash=5932d5805784c34e816d0f443040d7eb}{%
           family={Teo},
           familyi={T\bibinitperiod},
           given={Amos},
           giveni={A\bibinitperiod}}}%
        {{hash=be0e999808d5e6dd7d4c77fa1e019a35}{%
           family={Yunus},
           familyi={Y\bibinitperiod},
           given={Anam},
           giveni={A\bibinitperiod}}}%
        {{hash=89b81451635166fcb37197f8034c95d9}{%
           family={Lupu},
           familyi={L\bibinitperiod},
           given={Andrei},
           giveni={A\bibinitperiod}}}%
        {{hash=d28f306dab0a156ae0ad889a94bef7bb}{%
           family={Alvarado},
           familyi={A\bibinitperiod},
           given={Andres},
           giveni={A\bibinitperiod}}}%
        {{hash=a452e7dc78896bd8aea0ce8cbcde161e}{%
           family={Caples},
           familyi={C\bibinitperiod},
           given={Andrew},
           giveni={A\bibinitperiod}}}%
        {{hash=98cfba14708bcf56744f90225338572e}{%
           family={Gu},
           familyi={G\bibinitperiod},
           given={Andrew},
           giveni={A\bibinitperiod}}}%
        {{hash=bb8cc10f8a196a031445b79268e837ba}{%
           family={Ho},
           familyi={H\bibinitperiod},
           given={Andrew},
           giveni={A\bibinitperiod}}}%
        {{hash=a2080b9d7f5596d56ff1c48c3b0bf6aa}{%
           family={Poulton},
           familyi={P\bibinitperiod},
           given={Andrew},
           giveni={A\bibinitperiod}}}%
        {{hash=f2c437270d4e2db1f791420ed8ac551a}{%
           family={Ryan},
           familyi={R\bibinitperiod},
           given={Andrew},
           giveni={A\bibinitperiod}}}%
        {{hash=39cbdced681e69a4d9c47277f4042810}{%
           family={Ramchandani},
           familyi={R\bibinitperiod},
           given={Ankit},
           giveni={A\bibinitperiod}}}%
        {{hash=4d9ca4e485dc44ccb2cb1513d6a82cca}{%
           family={Dong},
           familyi={D\bibinitperiod},
           given={Annie},
           giveni={A\bibinitperiod}}}%
        {{hash=7db8b1027b55d4c2c8dc5778a254cd8b}{%
           family={Franco},
           familyi={F\bibinitperiod},
           given={Annie},
           giveni={A\bibinitperiod}}}%
        {{hash=a1c6baccad2cf73a63a17d4675dd2092}{%
           family={Goyal},
           familyi={G\bibinitperiod},
           given={Anuj},
           giveni={A\bibinitperiod}}}%
        {{hash=331939d1aad3f3e466c0eb41b1739e48}{%
           family={Saraf},
           familyi={S\bibinitperiod},
           given={Aparajita},
           giveni={A\bibinitperiod}}}%
        {{hash=4401d7038ab283d97db93f8c106d8087}{%
           family={Chowdhury},
           familyi={C\bibinitperiod},
           given={Arkabandhu},
           giveni={A\bibinitperiod}}}%
        {{hash=eb8a956fa9100c20675c2ee391fc7690}{%
           family={Gabriel},
           familyi={G\bibinitperiod},
           given={Ashley},
           giveni={A\bibinitperiod}}}%
        {{hash=3f6a694e9a7267ec68effb5fdaf12c1c}{%
           family={Bharambe},
           familyi={B\bibinitperiod},
           given={Ashwin},
           giveni={A\bibinitperiod}}}%
        {{hash=7340ee2f132a35281d3204fd988c70fe}{%
           family={Eisenman},
           familyi={E\bibinitperiod},
           given={Assaf},
           giveni={A\bibinitperiod}}}%
        {{hash=1b5c67fc4afdd85c2436b2d9d3f942b7}{%
           family={Yazdan},
           familyi={Y\bibinitperiod},
           given={Azadeh},
           giveni={A\bibinitperiod}}}%
        {{hash=6254b751ef20420ced84e035f2ed2139}{%
           family={James},
           familyi={J\bibinitperiod},
           given={Beau},
           giveni={B\bibinitperiod}}}%
        {{hash=dbf8ae26b403ade00095d259a53cc2c8}{%
           family={Maurer},
           familyi={M\bibinitperiod},
           given={Ben},
           giveni={B\bibinitperiod}}}%
        {{hash=afa7e051f634e451742bd0b2a88f4d59}{%
           family={Leonhardi},
           familyi={L\bibinitperiod},
           given={Benjamin},
           giveni={B\bibinitperiod}}}%
        {{hash=c219c269757ff4df4a753b12299956cb}{%
           family={Huang},
           familyi={H\bibinitperiod},
           given={Bernie},
           giveni={B\bibinitperiod}}}%
        {{hash=3aef1d7739808a2eac496e70b92c58b9}{%
           family={Loyd},
           familyi={L\bibinitperiod},
           given={Beth},
           giveni={B\bibinitperiod}}}%
        {{hash=9266fea639391d2bbeb3a046b64218c8}{%
           family={Paola},
           familyi={P\bibinitperiod},
           given={Beto\bibnamedelima De},
           giveni={B\bibinitperiod\bibinitdelim D\bibinitperiod}}}%
        {{hash=d8e8976ad7ec5848c2f5557280aa5cdf}{%
           family={Paranjape},
           familyi={P\bibinitperiod},
           given={Bhargavi},
           giveni={B\bibinitperiod}}}%
        {{hash=9c6fb2af2964f3126cfd4e505a38daca}{%
           family={Liu},
           familyi={L\bibinitperiod},
           given={Bing},
           giveni={B\bibinitperiod}}}%
        {{hash=a3467545efc97f24be8a5d66e4c70ab4}{%
           family={Wu},
           familyi={W\bibinitperiod},
           given={Bo},
           giveni={B\bibinitperiod}}}%
        {{hash=2f60b1b93fe3c1ea1a5dfcf2cec5dec1}{%
           family={Ni},
           familyi={N\bibinitperiod},
           given={Boyu},
           giveni={B\bibinitperiod}}}%
        {{hash=f003085c93285865f04f94323f8e1f55}{%
           family={Hancock},
           familyi={H\bibinitperiod},
           given={Braden},
           giveni={B\bibinitperiod}}}%
        {{hash=a486bf67c8cfeb78e434e64aa3e7de20}{%
           family={Wasti},
           familyi={W\bibinitperiod},
           given={Bram},
           giveni={B\bibinitperiod}}}%
        {{hash=83052ea7cb96114307dd409b3e563e95}{%
           family={Spence},
           familyi={S\bibinitperiod},
           given={Brandon},
           giveni={B\bibinitperiod}}}%
        {{hash=1662eb5e488536c1f5363556c2bf503d}{%
           family={Stojkovic},
           familyi={S\bibinitperiod},
           given={Brani},
           giveni={B\bibinitperiod}}}%
        {{hash=cb296ca2c75dca6391edb314d6943e54}{%
           family={Gamido},
           familyi={G\bibinitperiod},
           given={Brian},
           giveni={B\bibinitperiod}}}%
        {{hash=7b9c61ccfd8b3b9aa97317d0891e295c}{%
           family={Montalvo},
           familyi={M\bibinitperiod},
           given={Britt},
           giveni={B\bibinitperiod}}}%
        {{hash=09b953d7bf65fc43bb2742ffb96979ed}{%
           family={Parker},
           familyi={P\bibinitperiod},
           given={Carl},
           giveni={C\bibinitperiod}}}%
        {{hash=6547ed8bd56811accdf46e83b2f310ff}{%
           family={Burton},
           familyi={B\bibinitperiod},
           given={Carly},
           giveni={C\bibinitperiod}}}%
        {{hash=e5caf4b91e54513114f4b2e9d004e792}{%
           family={Mejia},
           familyi={M\bibinitperiod},
           given={Catalina},
           giveni={C\bibinitperiod}}}%
        {{hash=17bf470b120f24c48675bbcb261cab37}{%
           family={Liu},
           familyi={L\bibinitperiod},
           given={Ce},
           giveni={C\bibinitperiod}}}%
        {{hash=2242e23b82996e29a58069cd958eaca7}{%
           family={Wang},
           familyi={W\bibinitperiod},
           given={Changhan},
           giveni={C\bibinitperiod}}}%
        {{hash=2a1aad94984767bead4473eb7fd34080}{%
           family={Kim},
           familyi={K\bibinitperiod},
           given={Changkyu},
           giveni={C\bibinitperiod}}}%
        {{hash=a82f7b211fe415c0eccfd31925edc866}{%
           family={Zhou},
           familyi={Z\bibinitperiod},
           given={Chao},
           giveni={C\bibinitperiod}}}%
        {{hash=b03cef620e9fd30846f3540e0c09870f}{%
           family={Hu},
           familyi={H\bibinitperiod},
           given={Chester},
           giveni={C\bibinitperiod}}}%
        {{hash=2ccc00af77367adad3939db00bea965f}{%
           family={Chu},
           familyi={C\bibinitperiod},
           given={Ching-Hsiang},
           giveni={C\bibinithyphendelim H\bibinitperiod}}}%
        {{hash=7b2e6a6b72466725c4366d7c38b4fc04}{%
           family={Cai},
           familyi={C\bibinitperiod},
           given={Chris},
           giveni={C\bibinitperiod}}}%
        {{hash=1181defc635c4d87648d74557914379f}{%
           family={Tindal},
           familyi={T\bibinitperiod},
           given={Chris},
           giveni={C\bibinitperiod}}}%
        {{hash=bd2fff33d3a5433188d2662695e79eb5}{%
           family={Feichtenhofer},
           familyi={F\bibinitperiod},
           given={Christoph},
           giveni={C\bibinitperiod}}}%
        {{hash=8ba5b0a41692cd620325c1fc0a9dc84a}{%
           family={Gao},
           familyi={G\bibinitperiod},
           given={Cynthia},
           giveni={C\bibinitperiod}}}%
        {{hash=8ca7956e6e672d37fb851f87283db254}{%
           family={Civin},
           familyi={C\bibinitperiod},
           given={Damon},
           giveni={D\bibinitperiod}}}%
        {{hash=058b5e7e33c66f97e4c7390ae4f31c77}{%
           family={Beaty},
           familyi={B\bibinitperiod},
           given={Dana},
           giveni={D\bibinitperiod}}}%
        {{hash=df2d84aa0d9f71306f386f2e0ba4a56e}{%
           family={Kreymer},
           familyi={K\bibinitperiod},
           given={Daniel},
           giveni={D\bibinitperiod}}}%
        {{hash=4ef9f067fa7dd881ebe6076d3c1d1c5f}{%
           family={Li},
           familyi={L\bibinitperiod},
           given={Daniel},
           giveni={D\bibinitperiod}}}%
        {{hash=6ac810290b1640b6062b03b865aa3f26}{%
           family={Adkins},
           familyi={A\bibinitperiod},
           given={David},
           giveni={D\bibinitperiod}}}%
        {{hash=4ab4bfa54620bfb6e3beb068ed5d87c7}{%
           family={Xu},
           familyi={X\bibinitperiod},
           given={David},
           giveni={D\bibinitperiod}}}%
        {{hash=b8388eead45ea4429fa88916bc9a6cd5}{%
           family={Testuggine},
           familyi={T\bibinitperiod},
           given={Davide},
           giveni={D\bibinitperiod}}}%
        {{hash=d0243a1eeb11d9a28d68e4837a3f219d}{%
           family={David},
           familyi={D\bibinitperiod},
           given={Delia},
           giveni={D\bibinitperiod}}}%
        {{hash=d0ab7a4601951a0c59352f1dcb531afb}{%
           family={Parikh},
           familyi={P\bibinitperiod},
           given={Devi},
           giveni={D\bibinitperiod}}}%
        {{hash=727001a7f22db6717a536a1042b6f98b}{%
           family={Liskovich},
           familyi={L\bibinitperiod},
           given={Diana},
           giveni={D\bibinitperiod}}}%
        {{hash=aee34486f0fd233b49c203b3d130f41e}{%
           family={Foss},
           familyi={F\bibinitperiod},
           given={Didem},
           giveni={D\bibinitperiod}}}%
        {{hash=6febfd7fda62e1c77a555b50c9af4748}{%
           family={Wang},
           familyi={W\bibinitperiod},
           given={Dingkang},
           giveni={D\bibinitperiod}}}%
        {{hash=8c94a3f45f138176d92596819219883c}{%
           family={Le},
           familyi={L\bibinitperiod},
           given={Duc},
           giveni={D\bibinitperiod}}}%
        {{hash=bc5feac31f8fc7de99343e7e1aa94b59}{%
           family={Holland},
           familyi={H\bibinitperiod},
           given={Dustin},
           giveni={D\bibinitperiod}}}%
        {{hash=29f7b97ba50d0cbdb026f2c915c20d41}{%
           family={Dowling},
           familyi={D\bibinitperiod},
           given={Edward},
           giveni={E\bibinitperiod}}}%
        {{hash=daa6288a29af11a3a945b3c6570e923c}{%
           family={Jamil},
           familyi={J\bibinitperiod},
           given={Eissa},
           giveni={E\bibinitperiod}}}%
        {{hash=174e31a1aa41b374bb067963b6d2a13b}{%
           family={Montgomery},
           familyi={M\bibinitperiod},
           given={Elaine},
           giveni={E\bibinitperiod}}}%
        {{hash=360e2ddb867a61eb479ae7d054745568}{%
           family={Presani},
           familyi={P\bibinitperiod},
           given={Eleonora},
           giveni={E\bibinitperiod}}}%
        {{hash=ae9b4e3637efc7f1be303e3a65679b65}{%
           family={Hahn},
           familyi={H\bibinitperiod},
           given={Emily},
           giveni={E\bibinitperiod}}}%
        {{hash=a3f5964b64c780013113e6c7ec9fd077}{%
           family={Wood},
           familyi={W\bibinitperiod},
           given={Emily},
           giveni={E\bibinitperiod}}}%
        {{hash=93fc269f0dd4a6f7aa03bd0ec36e72bf}{%
           family={Le},
           familyi={L\bibinitperiod},
           given={Eric-Tuan},
           giveni={E\bibinithyphendelim T\bibinitperiod}}}%
        {{hash=1720f8a37adce15a8477dcca02991c42}{%
           family={Brinkman},
           familyi={B\bibinitperiod},
           given={Erik},
           giveni={E\bibinitperiod}}}%
        {{hash=2201729bd61693bd36df860408450550}{%
           family={Arcaute},
           familyi={A\bibinitperiod},
           given={Esteban},
           giveni={E\bibinitperiod}}}%
        {{hash=51c48faf493d65df58dd924e74339197}{%
           family={Dunbar},
           familyi={D\bibinitperiod},
           given={Evan},
           giveni={E\bibinitperiod}}}%
        {{hash=12ce8810094604a466f2b16a711b350d}{%
           family={Smothers},
           familyi={S\bibinitperiod},
           given={Evan},
           giveni={E\bibinitperiod}}}%
        {{hash=0fff2d014f575fc5d680e70e02e8ce38}{%
           family={Sun},
           familyi={S\bibinitperiod},
           given={Fei},
           giveni={F\bibinitperiod}}}%
        {{hash=7b9f656a709e39ab921a2319da205e6b}{%
           family={Kreuk},
           familyi={K\bibinitperiod},
           given={Felix},
           giveni={F\bibinitperiod}}}%
        {{hash=1487e60477fb6a315fa69b2f8ee53c9f}{%
           family={Tian},
           familyi={T\bibinitperiod},
           given={Feng},
           giveni={F\bibinitperiod}}}%
        {{hash=d3dbc65779f0402cc427ae4798da5271}{%
           family={Kokkinos},
           familyi={K\bibinitperiod},
           given={Filippos},
           giveni={F\bibinitperiod}}}%
        {{hash=b99972de6b245e2104b4eacd84a61fc6}{%
           family={Ozgenel},
           familyi={O\bibinitperiod},
           given={Firat},
           giveni={F\bibinitperiod}}}%
        {{hash=d4eb4c0bac6f1261470c119f71c81bb8}{%
           family={Caggioni},
           familyi={C\bibinitperiod},
           given={Francesco},
           giveni={F\bibinitperiod}}}%
        {{hash=f736a2cbfb475ab66e4513656b1e5cc4}{%
           family={Kanayet},
           familyi={K\bibinitperiod},
           given={Frank},
           giveni={F\bibinitperiod}}}%
        {{hash=ef03c6cf9b4db1e1c72b2202a2b4ab62}{%
           family={Seide},
           familyi={S\bibinitperiod},
           given={Frank},
           giveni={F\bibinitperiod}}}%
        {{hash=3f0a19d35feafb9f65696b5dc34cac51}{%
           family={Florez},
           familyi={F\bibinitperiod},
           given={Gabriela\bibnamedelima Medina},
           giveni={G\bibinitperiod\bibinitdelim M\bibinitperiod}}}%
        {{hash=384b4168a5627486c8f2863f21193b39}{%
           family={Schwarz},
           familyi={S\bibinitperiod},
           given={Gabriella},
           giveni={G\bibinitperiod}}}%
        {{hash=c586335e51a7a87f4ef46cba95d55596}{%
           family={Badeer},
           familyi={B\bibinitperiod},
           given={Gada},
           giveni={G\bibinitperiod}}}%
        {{hash=2adac47a7bc3aafff7340267307f70b4}{%
           family={Swee},
           familyi={S\bibinitperiod},
           given={Georgia},
           giveni={G\bibinitperiod}}}%
        {{hash=89b56db5c795155a6fb477702b8d5581}{%
           family={Halpern},
           familyi={H\bibinitperiod},
           given={Gil},
           giveni={G\bibinitperiod}}}%
        {{hash=37ec7fa8deaf3d2beea69784038208a0}{%
           family={Herman},
           familyi={H\bibinitperiod},
           given={Grant},
           giveni={G\bibinitperiod}}}%
        {{hash=12156b26e288b160b4084dd01f5f2433}{%
           family={Sizov},
           familyi={S\bibinitperiod},
           given={Grigory},
           giveni={G\bibinitperiod}}}%
        {{hash=9d418d200efef33c32bc46e8dc4a9359}{%
           family={Guangyi},
           familyi={G\bibinitperiod}}}%
        {{hash=96641e4a5a09e69b32236adbdfd55407}{%
           family={Zhang},
           familyi={Z\bibinitperiod}}}%
        {{hash=14ad5c11fc07d52d855b3fab9364e3b2}{%
           family={Lakshminarayanan},
           familyi={L\bibinitperiod},
           given={Guna},
           giveni={G\bibinitperiod}}}%
        {{hash=3bf2bb5e273c329482dd632f9a6aaead}{%
           family={Inan},
           familyi={I\bibinitperiod},
           given={Hakan},
           giveni={H\bibinitperiod}}}%
        {{hash=1edddb2944fb62f8da41fffb45d5aa81}{%
           family={Shojanazeri},
           familyi={S\bibinitperiod},
           given={Hamid},
           giveni={H\bibinitperiod}}}%
        {{hash=b6770a40a9ff8665ab0cd2e6541f3240}{%
           family={Zou},
           familyi={Z\bibinitperiod},
           given={Han},
           giveni={H\bibinitperiod}}}%
        {{hash=40449267be2ba6897871104bc8331651}{%
           family={Wang},
           familyi={W\bibinitperiod},
           given={Hannah},
           giveni={H\bibinitperiod}}}%
        {{hash=9dfe209df23e6d03983a09530a82cb3d}{%
           family={Zha},
           familyi={Z\bibinitperiod},
           given={Hanwen},
           giveni={H\bibinitperiod}}}%
        {{hash=0c672199b1759a017363c25814efa131}{%
           family={Habeeb},
           familyi={H\bibinitperiod},
           given={Haroun},
           giveni={H\bibinitperiod}}}%
        {{hash=7b715ce32bdd298a7fb03f43611662af}{%
           family={Rudolph},
           familyi={R\bibinitperiod},
           given={Harrison},
           giveni={H\bibinitperiod}}}%
        {{hash=8bf7efa7375ec8441db1315cb6341021}{%
           family={Suk},
           familyi={S\bibinitperiod},
           given={Helen},
           giveni={H\bibinitperiod}}}%
        {{hash=22864511e9484bbaa1d6813336431ad9}{%
           family={Aspegren},
           familyi={A\bibinitperiod},
           given={Henry},
           giveni={H\bibinitperiod}}}%
        {{hash=689667fa714c2b602d05f3914d3a0725}{%
           family={Goldman},
           familyi={G\bibinitperiod},
           given={Hunter},
           giveni={H\bibinitperiod}}}%
        {{hash=b10b9b2738fd3d8d5f840065b0e0b73c}{%
           family={Zhan},
           familyi={Z\bibinitperiod},
           given={Hongyuan},
           giveni={H\bibinitperiod}}}%
        {{hash=42cdcc3f8e787e24f00227ace3ae337f}{%
           family={Damlaj},
           familyi={D\bibinitperiod},
           given={Ibrahim},
           giveni={I\bibinitperiod}}}%
        {{hash=9c9c8b449afb88c0a84739775b9c805a}{%
           family={Molybog},
           familyi={M\bibinitperiod},
           given={Igor},
           giveni={I\bibinitperiod}}}%
        {{hash=4fd0bfb5a490ac411200ecb4bfef3f11}{%
           family={Tufanov},
           familyi={T\bibinitperiod},
           given={Igor},
           giveni={I\bibinitperiod}}}%
        {{hash=b8cd35e34bfc5c9a7b270d6e7971d881}{%
           family={Leontiadis},
           familyi={L\bibinitperiod},
           given={Ilias},
           giveni={I\bibinitperiod}}}%
        {{hash=216c5d5b0ac00adf927eb88fade8f732}{%
           family={Veliche},
           familyi={V\bibinitperiod},
           given={Irina-Elena},
           giveni={I\bibinithyphendelim E\bibinitperiod}}}%
        {{hash=392591856940aee2897c65ba822d427b}{%
           family={Gat},
           familyi={G\bibinitperiod},
           given={Itai},
           giveni={I\bibinitperiod}}}%
        {{hash=bc66e3b1f664316b58e0fa7e96908782}{%
           family={Weissman},
           familyi={W\bibinitperiod},
           given={Jake},
           giveni={J\bibinitperiod}}}%
        {{hash=69e04724121064e19d266a9d52e93e1d}{%
           family={Geboski},
           familyi={G\bibinitperiod},
           given={James},
           giveni={J\bibinitperiod}}}%
        {{hash=3f17b4f956cd65800dd6498530521e36}{%
           family={Kohli},
           familyi={K\bibinitperiod},
           given={James},
           giveni={J\bibinitperiod}}}%
        {{hash=45b2043caa8c5a5b93538567756cb862}{%
           family={Lam},
           familyi={L\bibinitperiod},
           given={Janice},
           giveni={J\bibinitperiod}}}%
        {{hash=1c77614dbf40c86333a72fc8eceec34c}{%
           family={Asher},
           familyi={A\bibinitperiod},
           given={Japhet},
           giveni={J\bibinitperiod}}}%
        {{hash=dc250b018c408a1cc08c34e8a260090f}{%
           family={Gaya},
           familyi={G\bibinitperiod},
           given={Jean-Baptiste},
           giveni={J\bibinithyphendelim B\bibinitperiod}}}%
        {{hash=c341c5e189b2025238f2f39bb76b4947}{%
           family={Marcus},
           familyi={M\bibinitperiod},
           given={Jeff},
           giveni={J\bibinitperiod}}}%
        {{hash=cc3a414791478f4727d40c3ad7d09cd7}{%
           family={Tang},
           familyi={T\bibinitperiod},
           given={Jeff},
           giveni={J\bibinitperiod}}}%
        {{hash=d6d87955aa9f1e36aae0beb2c514bbbd}{%
           family={Chan},
           familyi={C\bibinitperiod},
           given={Jennifer},
           giveni={J\bibinitperiod}}}%
        {{hash=d2f41415278d8616e4711c471ab1873b}{%
           family={Zhen},
           familyi={Z\bibinitperiod},
           given={Jenny},
           giveni={J\bibinitperiod}}}%
        {{hash=8ba0e40bb2bd52546beafceb6b00d636}{%
           family={Reizenstein},
           familyi={R\bibinitperiod},
           given={Jeremy},
           giveni={J\bibinitperiod}}}%
        {{hash=26943fe4d27376d4354dd33390b14704}{%
           family={Teboul},
           familyi={T\bibinitperiod},
           given={Jeremy},
           giveni={J\bibinitperiod}}}%
        {{hash=a3c07cfb8f07a8a6e8f6a1eb59f2f6d6}{%
           family={Zhong},
           familyi={Z\bibinitperiod},
           given={Jessica},
           giveni={J\bibinitperiod}}}%
        {{hash=bb687b4404472c334bebf0bb6522d834}{%
           family={Jin},
           familyi={J\bibinitperiod},
           given={Jian},
           giveni={J\bibinitperiod}}}%
        {{hash=ed829830567c4c5d7f41d8a5c6871390}{%
           family={Yang},
           familyi={Y\bibinitperiod},
           given={Jingyi},
           giveni={J\bibinitperiod}}}%
        {{hash=8dbf9143627729104a6d6b0cfd7bf8bc}{%
           family={Cummings},
           familyi={C\bibinitperiod},
           given={Joe},
           giveni={J\bibinitperiod}}}%
        {{hash=c8a27f8b9e1b59daf8236999e928d9c8}{%
           family={Carvill},
           familyi={C\bibinitperiod},
           given={Jon},
           giveni={J\bibinitperiod}}}%
        {{hash=5c11475174c12ffc16f7741655c40161}{%
           family={Shepard},
           familyi={S\bibinitperiod},
           given={Jon},
           giveni={J\bibinitperiod}}}%
        {{hash=469d06adc4af09b08e9fa105b53879c8}{%
           family={McPhie},
           familyi={M\bibinitperiod},
           given={Jonathan},
           giveni={J\bibinitperiod}}}%
        {{hash=d1bf80616f29a28b111b65ce463503d1}{%
           family={Torres},
           familyi={T\bibinitperiod},
           given={Jonathan},
           giveni={J\bibinitperiod}}}%
        {{hash=25071ce9679f53750a15cfd7417fb8ca}{%
           family={Ginsburg},
           familyi={G\bibinitperiod},
           given={Josh},
           giveni={J\bibinitperiod}}}%
        {{hash=0311431642470a7b59cea4fbf9543da7}{%
           family={Wang},
           familyi={W\bibinitperiod},
           given={Junjie},
           giveni={J\bibinitperiod}}}%
        {{hash=6925c5dcdb9b5ed8f2a02432404549e7}{%
           family={Wu},
           familyi={W\bibinitperiod},
           given={Kai},
           giveni={K\bibinitperiod}}}%
        {{hash=754fb4fa1236164d9640c2837ad08976}{%
           family={U},
           familyi={U\bibinitperiod},
           given={Kam\bibnamedelima Hou},
           giveni={K\bibinitperiod\bibinitdelim H\bibinitperiod}}}%
        {{hash=411c62e43d66e155f8f0d60695dd8181}{%
           family={Saxena},
           familyi={S\bibinitperiod},
           given={Karan},
           giveni={K\bibinitperiod}}}%
        {{hash=9e9a1e2c7a348addec1212ed39541436}{%
           family={Khandelwal},
           familyi={K\bibinitperiod},
           given={Kartikay},
           giveni={K\bibinitperiod}}}%
        {{hash=c9d508e3ff06c17ab652a9e7abf1e68a}{%
           family={Zand},
           familyi={Z\bibinitperiod},
           given={Katayoun},
           giveni={K\bibinitperiod}}}%
        {{hash=8b140dcb364c626357a8fb98a018ebb5}{%
           family={Matosich},
           familyi={M\bibinitperiod},
           given={Kathy},
           giveni={K\bibinitperiod}}}%
        {{hash=f2c1fa48fb8bfe45a582cdb42d0f3d96}{%
           family={Veeraraghavan},
           familyi={V\bibinitperiod},
           given={Kaushik},
           giveni={K\bibinitperiod}}}%
        {{hash=741b4ea99ca87a9a2a08a4132c10ded8}{%
           family={Michelena},
           familyi={M\bibinitperiod},
           given={Kelly},
           giveni={K\bibinitperiod}}}%
        {{hash=e242ebe4f32fe5bd2dc39b67705e1c4e}{%
           family={Li},
           familyi={L\bibinitperiod},
           given={Keqian},
           giveni={K\bibinitperiod}}}%
        {{hash=c7b359c7b9b22622f87d0d4235ef725e}{%
           family={Jagadeesh},
           familyi={J\bibinitperiod},
           given={Kiran},
           giveni={K\bibinitperiod}}}%
        {{hash=d00246b1153ed058a9db188c365474ca}{%
           family={Huang},
           familyi={H\bibinitperiod},
           given={Kun},
           giveni={K\bibinitperiod}}}%
        {{hash=40599c412a1ddc8b236d536512792328}{%
           family={Chawla},
           familyi={C\bibinitperiod},
           given={Kunal},
           giveni={K\bibinitperiod}}}%
        {{hash=e17f32f060d0e2a15d317d2984d0ab35}{%
           family={Huang},
           familyi={H\bibinitperiod},
           given={Kyle},
           giveni={K\bibinitperiod}}}%
        {{hash=95c5a4f8b36337cc8d62b2d2a3f49e1f}{%
           family={Chen},
           familyi={C\bibinitperiod},
           given={Lailin},
           giveni={L\bibinitperiod}}}%
        {{hash=4c1946c76a98ceecd04eac7eed0dc1f7}{%
           family={Garg},
           familyi={G\bibinitperiod},
           given={Lakshya},
           giveni={L\bibinitperiod}}}%
        {{hash=42db2cd1749c72fa981f7ded523ada84}{%
           family={A},
           familyi={A\bibinitperiod},
           given={Lavender},
           giveni={L\bibinitperiod}}}%
        {{hash=1bf64285bb5330d70f13953440473a9a}{%
           family={Silva},
           familyi={S\bibinitperiod},
           given={Leandro},
           giveni={L\bibinitperiod}}}%
        {{hash=33fa3cdf541304a618bccc17fea57951}{%
           family={Bell},
           familyi={B\bibinitperiod},
           given={Lee},
           giveni={L\bibinitperiod}}}%
        {{hash=f4a4cbf770add19c206827116c68732e}{%
           family={Zhang},
           familyi={Z\bibinitperiod},
           given={Lei},
           giveni={L\bibinitperiod}}}%
        {{hash=516629b4d6f6f498f0b66fe2a90453f1}{%
           family={Guo},
           familyi={G\bibinitperiod},
           given={Liangpeng},
           giveni={L\bibinitperiod}}}%
        {{hash=be39c121bc7a07fa378493551b4a44c6}{%
           family={Yu},
           familyi={Y\bibinitperiod},
           given={Licheng},
           giveni={L\bibinitperiod}}}%
        {{hash=46b604ad3ed4cb60aeb537d78683a957}{%
           family={Moshkovich},
           familyi={M\bibinitperiod},
           given={Liron},
           giveni={L\bibinitperiod}}}%
        {{hash=484beeb805e576ed3bdb038c726f4959}{%
           family={Wehrstedt},
           familyi={W\bibinitperiod},
           given={Luca},
           giveni={L\bibinitperiod}}}%
        {{hash=2118ff6f53e7a26f72795cd86e0272e3}{%
           family={Khabsa},
           familyi={K\bibinitperiod},
           given={Madian},
           giveni={M\bibinitperiod}}}%
        {{hash=3e4f7696f3195621b9f462ed525356a7}{%
           family={Avalani},
           familyi={A\bibinitperiod},
           given={Manav},
           giveni={M\bibinitperiod}}}%
        {{hash=6f5d030d498f6e477b5966621575bba3}{%
           family={Bhatt},
           familyi={B\bibinitperiod},
           given={Manish},
           giveni={M\bibinitperiod}}}%
        {{hash=214d095b77c87bf3ca44fb9fdb919a22}{%
           family={Mankus},
           familyi={M\bibinitperiod},
           given={Martynas},
           giveni={M\bibinitperiod}}}%
        {{hash=843c622abc3fba6607bd660289251fa3}{%
           family={Hasson},
           familyi={H\bibinitperiod},
           given={Matan},
           giveni={M\bibinitperiod}}}%
        {{hash=e1761bb9763e5e762225ab7276392c5c}{%
           family={Lennie},
           familyi={L\bibinitperiod},
           given={Matthew},
           giveni={M\bibinitperiod}}}%
        {{hash=525237a0a8567b38319596dc54130c17}{%
           family={Reso},
           familyi={R\bibinitperiod},
           given={Matthias},
           giveni={M\bibinitperiod}}}%
        {{hash=9fb44e80abf1fa021cccac0860d5e882}{%
           family={Groshev},
           familyi={G\bibinitperiod},
           given={Maxim},
           giveni={M\bibinitperiod}}}%
        {{hash=c1805b2dbda273718fab95ee7582f4bf}{%
           family={Naumov},
           familyi={N\bibinitperiod},
           given={Maxim},
           giveni={M\bibinitperiod}}}%
        {{hash=0b5be788efcc10f366aa0a94b20fe4b9}{%
           family={Lathi},
           familyi={L\bibinitperiod},
           given={Maya},
           giveni={M\bibinitperiod}}}%
        {{hash=1b5a1f51491e8a8f32e8817961f6ffb9}{%
           family={Keneally},
           familyi={K\bibinitperiod},
           given={Meghan},
           giveni={M\bibinitperiod}}}%
        {{hash=0474cc7d2cd3785ad22074a7b4abeb8b}{%
           family={Liu},
           familyi={L\bibinitperiod},
           given={Miao},
           giveni={M\bibinitperiod}}}%
        {{hash=57e3d899218bce9cfe05fae5fadb5f32}{%
           family={Seltzer},
           familyi={S\bibinitperiod},
           given={Michael\bibnamedelima L.},
           giveni={M\bibinitperiod\bibinitdelim L\bibinitperiod}}}%
        {{hash=e25b9b55e0d33d8e554fb428b0122ba9}{%
           family={Valko},
           familyi={V\bibinitperiod},
           given={Michal},
           giveni={M\bibinitperiod}}}%
        {{hash=04cab131fdae8df59ad85786012e0958}{%
           family={Restrepo},
           familyi={R\bibinitperiod},
           given={Michelle},
           giveni={M\bibinitperiod}}}%
        {{hash=0978b7a664572d10be33e089a43fabb3}{%
           family={Patel},
           familyi={P\bibinitperiod},
           given={Mihir},
           giveni={M\bibinitperiod}}}%
        {{hash=1f4f7f284fd53ba80361ded56d164beb}{%
           family={Vyatskov},
           familyi={V\bibinitperiod},
           given={Mik},
           giveni={M\bibinitperiod}}}%
        {{hash=c76172ee0c2ebda81796624b4a81ae54}{%
           family={Samvelyan},
           familyi={S\bibinitperiod},
           given={Mikayel},
           giveni={M\bibinitperiod}}}%
        {{hash=84666a285b6823b0dd9c9650fc5302b8}{%
           family={Clark},
           familyi={C\bibinitperiod},
           given={Mike},
           giveni={M\bibinitperiod}}}%
        {{hash=e3b7d3ac3c41fc36ca2ef0ced3c002dc}{%
           family={Macey},
           familyi={M\bibinitperiod},
           given={Mike},
           giveni={M\bibinitperiod}}}%
        {{hash=12c4fa347402de7d37d2afca53eaeafa}{%
           family={Wang},
           familyi={W\bibinitperiod},
           given={Mike},
           giveni={M\bibinitperiod}}}%
        {{hash=551f0565843ce1ed2171ac143389a806}{%
           family={Hermoso},
           familyi={H\bibinitperiod},
           given={Miquel\bibnamedelima Jubert},
           giveni={M\bibinitperiod\bibinitdelim J\bibinitperiod}}}%
        {{hash=1e85fc0bfe1b19bd3ef45a62aaf57028}{%
           family={Metanat},
           familyi={M\bibinitperiod},
           given={Mo},
           giveni={M\bibinitperiod}}}%
        {{hash=6e8b3d38b127f6e4cb3d429818c0fac8}{%
           family={Rastegari},
           familyi={R\bibinitperiod},
           given={Mohammad},
           giveni={M\bibinitperiod}}}%
        {{hash=65085c9b21420333482c003abb19468e}{%
           family={Bansal},
           familyi={B\bibinitperiod},
           given={Munish},
           giveni={M\bibinitperiod}}}%
        {{hash=361e3b1f0e54cfc90f70d2b0bb66997f}{%
           family={Santhanam},
           familyi={S\bibinitperiod},
           given={Nandhini},
           giveni={N\bibinitperiod}}}%
        {{hash=59d8b34d1d4e1679c5bac7e159a41489}{%
           family={Parks},
           familyi={P\bibinitperiod},
           given={Natascha},
           giveni={N\bibinitperiod}}}%
        {{hash=b00d242b09ee167e04b67656c6f7606e}{%
           family={White},
           familyi={W\bibinitperiod},
           given={Natasha},
           giveni={N\bibinitperiod}}}%
        {{hash=78b25d3076bbe3ee363aae67c0efbf02}{%
           family={Bawa},
           familyi={B\bibinitperiod},
           given={Navyata},
           giveni={N\bibinitperiod}}}%
        {{hash=e898c478735b6cf02851f3193ad09bd9}{%
           family={Singhal},
           familyi={S\bibinitperiod},
           given={Nayan},
           giveni={N\bibinitperiod}}}%
        {{hash=97aa82e640185022596b22bca0ef300c}{%
           family={Egebo},
           familyi={E\bibinitperiod},
           given={Nick},
           giveni={N\bibinitperiod}}}%
        {{hash=26e026be6d5366fce878100ba03d68c1}{%
           family={Usunier},
           familyi={U\bibinitperiod},
           given={Nicolas},
           giveni={N\bibinitperiod}}}%
        {{hash=093485a23f5ff6c5f297acabc67a9a98}{%
           family={Mehta},
           familyi={M\bibinitperiod},
           given={Nikhil},
           giveni={N\bibinitperiod}}}%
        {{hash=e223633878a94510de938c3067713e4d}{%
           family={Laptev},
           familyi={L\bibinitperiod},
           given={Nikolay\bibnamedelima Pavlovich},
           giveni={N\bibinitperiod\bibinitdelim P\bibinitperiod}}}%
        {{hash=5d4e37543d0a89c80560b2dbf014118e}{%
           family={Dong},
           familyi={D\bibinitperiod},
           given={Ning},
           giveni={N\bibinitperiod}}}%
        {{hash=6e32934aad5bb7752713e459961e0100}{%
           family={Cheng},
           familyi={C\bibinitperiod},
           given={Norman},
           giveni={N\bibinitperiod}}}%
        {{hash=ef6569ed842d1879c34afafd032057a7}{%
           family={Chernoguz},
           familyi={C\bibinitperiod},
           given={Oleg},
           giveni={O\bibinitperiod}}}%
        {{hash=46abce9f68c25ae9656bd93949debc05}{%
           family={Hart},
           familyi={H\bibinitperiod},
           given={Olivia},
           giveni={O\bibinitperiod}}}%
        {{hash=5466d745ccee0c7909ef89b2f94f8e08}{%
           family={Salpekar},
           familyi={S\bibinitperiod},
           given={Omkar},
           giveni={O\bibinitperiod}}}%
        {{hash=561024889f4a812f6cb7d9063bcf1d83}{%
           family={Kalinli},
           familyi={K\bibinitperiod},
           given={Ozlem},
           giveni={O\bibinitperiod}}}%
        {{hash=b6a785629bec552dd1dc659a7b81ff78}{%
           family={Kent},
           familyi={K\bibinitperiod},
           given={Parkin},
           giveni={P\bibinitperiod}}}%
        {{hash=8e2b190b86f26285662a8e910614422c}{%
           family={Parekh},
           familyi={P\bibinitperiod},
           given={Parth},
           giveni={P\bibinitperiod}}}%
        {{hash=a582947a894c4f27a43566adf5904b09}{%
           family={Saab},
           familyi={S\bibinitperiod},
           given={Paul},
           giveni={P\bibinitperiod}}}%
        {{hash=2cd3bd4809dbde380ae860afaa14b96f}{%
           family={Balaji},
           familyi={B\bibinitperiod},
           given={Pavan},
           giveni={P\bibinitperiod}}}%
        {{hash=4696787aed627eba66219d10375b6128}{%
           family={Rittner},
           familyi={R\bibinitperiod},
           given={Pedro},
           giveni={P\bibinitperiod}}}%
        {{hash=4505e041f77b137101094a2522aed23c}{%
           family={Bontrager},
           familyi={B\bibinitperiod},
           given={Philip},
           giveni={P\bibinitperiod}}}%
        {{hash=8ba9a81fd07b2afc16974cc75cf15e44}{%
           family={Roux},
           familyi={R\bibinitperiod},
           given={Pierre},
           giveni={P\bibinitperiod}}}%
        {{hash=37843fd1a96680e7945ac1a059b6e8b8}{%
           family={Dollar},
           familyi={D\bibinitperiod},
           given={Piotr},
           giveni={P\bibinitperiod}}}%
        {{hash=adcb9674130166d4fa309e9d5f19f59e}{%
           family={Zvyagina},
           familyi={Z\bibinitperiod},
           given={Polina},
           giveni={P\bibinitperiod}}}%
        {{hash=4497eb0b3d2072c0fb4bb0551f2324bd}{%
           family={Ratanchandani},
           familyi={R\bibinitperiod},
           given={Prashant},
           giveni={P\bibinitperiod}}}%
        {{hash=62888c883b7e544f3a3a50615d636636}{%
           family={Yuvraj},
           familyi={Y\bibinitperiod},
           given={Pritish},
           giveni={P\bibinitperiod}}}%
        {{hash=7484697c75d89fdf767ab363a99d7137}{%
           family={Liang},
           familyi={L\bibinitperiod},
           given={Qian},
           giveni={Q\bibinitperiod}}}%
        {{hash=0e73c5981dca93e449b0efb107db6db6}{%
           family={Alao},
           familyi={A\bibinitperiod},
           given={Rachad},
           giveni={R\bibinitperiod}}}%
        {{hash=3f382a8348081765315e0446d6f403a8}{%
           family={Rodriguez},
           familyi={R\bibinitperiod},
           given={Rachel},
           giveni={R\bibinitperiod}}}%
        {{hash=b174cc506ed225668695f2609de76e3f}{%
           family={Ayub},
           familyi={A\bibinitperiod},
           given={Rafi},
           giveni={R\bibinitperiod}}}%
        {{hash=f17734bc656d4669ac3abc24701d4edf}{%
           family={Murthy},
           familyi={M\bibinitperiod},
           given={Raghotham},
           giveni={R\bibinitperiod}}}%
        {{hash=5da021d30571b56410defdad33c2e35b}{%
           family={Nayani},
           familyi={N\bibinitperiod},
           given={Raghu},
           giveni={R\bibinitperiod}}}%
        {{hash=058e8580308268593962390f561faa2a}{%
           family={Mitra},
           familyi={M\bibinitperiod},
           given={Rahul},
           giveni={R\bibinitperiod}}}%
        {{hash=e46735bc94d62c1088fc89ac05a123ad}{%
           family={Parthasarathy},
           familyi={P\bibinitperiod},
           given={Rangaprabhu},
           giveni={R\bibinitperiod}}}%
        {{hash=c1759f73dac024a1af9f576ddaa00100}{%
           family={Li},
           familyi={L\bibinitperiod},
           given={Raymond},
           giveni={R\bibinitperiod}}}%
        {{hash=01eddc92feded963d2f72d2412e9f396}{%
           family={Hogan},
           familyi={H\bibinitperiod},
           given={Rebekkah},
           giveni={R\bibinitperiod}}}%
        {{hash=dbf8d9ec4075dd9a2fe082c2f8d0ac72}{%
           family={Battey},
           familyi={B\bibinitperiod},
           given={Robin},
           giveni={R\bibinitperiod}}}%
        {{hash=6940d52693f30b2bb9a4473706040190}{%
           family={Wang},
           familyi={W\bibinitperiod},
           given={Rocky},
           giveni={R\bibinitperiod}}}%
        {{hash=5138c225dc242e3f114b9da707387511}{%
           family={Howes},
           familyi={H\bibinitperiod},
           given={Russ},
           giveni={R\bibinitperiod}}}%
        {{hash=df656146081384635aff4a9c77caf560}{%
           family={Rinott},
           familyi={R\bibinitperiod},
           given={Ruty},
           giveni={R\bibinitperiod}}}%
        {{hash=90feecf4f2f08ae7f3b8e33214091f72}{%
           family={Mehta},
           familyi={M\bibinitperiod},
           given={Sachin},
           giveni={S\bibinitperiod}}}%
        {{hash=72ec8005ba6d04081e4d030f6acb5f36}{%
           family={Siby},
           familyi={S\bibinitperiod},
           given={Sachin},
           giveni={S\bibinitperiod}}}%
        {{hash=958e1bcb3b330bcdb2831c11b58d94d4}{%
           family={Bondu},
           familyi={B\bibinitperiod},
           given={Sai\bibnamedelima Jayesh},
           giveni={S\bibinitperiod\bibinitdelim J\bibinitperiod}}}%
        {{hash=2db605f7dff5b8203e3ddbc6a04d06a8}{%
           family={Datta},
           familyi={D\bibinitperiod},
           given={Samyak},
           giveni={S\bibinitperiod}}}%
        {{hash=83b3d704d819953704f3d8a468f1dfdf}{%
           family={Chugh},
           familyi={C\bibinitperiod},
           given={Sara},
           giveni={S\bibinitperiod}}}%
        {{hash=88e7821bdca0652c6d651019f5f925de}{%
           family={Hunt},
           familyi={H\bibinitperiod},
           given={Sara},
           giveni={S\bibinitperiod}}}%
        {{hash=59e6cded8046670ba4c60e653c2af6e8}{%
           family={Dhillon},
           familyi={D\bibinitperiod},
           given={Sargun},
           giveni={S\bibinitperiod}}}%
        {{hash=5ced057cee4ef377f620b76bbec988a7}{%
           family={Sidorov},
           familyi={S\bibinitperiod},
           given={Sasha},
           giveni={S\bibinitperiod}}}%
        {{hash=7c837fcacb7310e658a14a018c0b8693}{%
           family={Pan},
           familyi={P\bibinitperiod},
           given={Satadru},
           giveni={S\bibinitperiod}}}%
        {{hash=c30c1797171696f84e66916c49e9399b}{%
           family={Mahajan},
           familyi={M\bibinitperiod},
           given={Saurabh},
           giveni={S\bibinitperiod}}}%
        {{hash=be9199e2769b280d8e77f985de477790}{%
           family={Verma},
           familyi={V\bibinitperiod},
           given={Saurabh},
           giveni={S\bibinitperiod}}}%
        {{hash=1062b9e0f56fa30ed0a08eb73a68cd55}{%
           family={Yamamoto},
           familyi={Y\bibinitperiod},
           given={Seiji},
           giveni={S\bibinitperiod}}}%
        {{hash=f8f3cf465fedf0755bf26602fe05a5d3}{%
           family={Ramaswamy},
           familyi={R\bibinitperiod},
           given={Sharadh},
           giveni={S\bibinitperiod}}}%
        {{hash=6b54dbf4b3be2a123135dfdd1420ec32}{%
           family={Lindsay},
           familyi={L\bibinitperiod},
           given={Shaun},
           giveni={S\bibinitperiod}}}%
        {{hash=6b54dbf4b3be2a123135dfdd1420ec32}{%
           family={Lindsay},
           familyi={L\bibinitperiod},
           given={Shaun},
           giveni={S\bibinitperiod}}}%
        {{hash=172cdc3272a4a6fc64f5ee3792950ef4}{%
           family={Feng},
           familyi={F\bibinitperiod},
           given={Sheng},
           giveni={S\bibinitperiod}}}%
        {{hash=51b8004fa93e880b6584ed12b5472fc6}{%
           family={Lin},
           familyi={L\bibinitperiod},
           given={Shenghao},
           giveni={S\bibinitperiod}}}%
        {{hash=6950cf3c852aa626e12e9607f46cf864}{%
           family={Zha},
           familyi={Z\bibinitperiod},
           given={Shengxin\bibnamedelima Cindy},
           giveni={S\bibinitperiod\bibinitdelim C\bibinitperiod}}}%
        {{hash=e0eb0651673983a0cd132dba24d5dc7f}{%
           family={Patil},
           familyi={P\bibinitperiod},
           given={Shishir},
           giveni={S\bibinitperiod}}}%
        {{hash=eab9dab4b3286059e4ba07f8493313ca}{%
           family={Shankar},
           familyi={S\bibinitperiod},
           given={Shiva},
           giveni={S\bibinitperiod}}}%
        {{hash=f263556bc4337effab2effa8385dd0df}{%
           family={Zhang},
           familyi={Z\bibinitperiod},
           given={Shuqiang},
           giveni={S\bibinitperiod}}}%
        {{hash=f263556bc4337effab2effa8385dd0df}{%
           family={Zhang},
           familyi={Z\bibinitperiod},
           given={Shuqiang},
           giveni={S\bibinitperiod}}}%
        {{hash=27edaeac6106fc95a1e9855b71069c26}{%
           family={Wang},
           familyi={W\bibinitperiod},
           given={Sinong},
           giveni={S\bibinitperiod}}}%
        {{hash=71affa1854c02810f731258a9f269935}{%
           family={Agarwal},
           familyi={A\bibinitperiod},
           given={Sneha},
           giveni={S\bibinitperiod}}}%
        {{hash=3757c94a3a9be01806970f24b1f4bfde}{%
           family={Sajuyigbe},
           familyi={S\bibinitperiod},
           given={Soji},
           giveni={S\bibinitperiod}}}%
        {{hash=8ef51a0906e47d2b4472c4e714ed598f}{%
           family={Chintala},
           familyi={C\bibinitperiod},
           given={Soumith},
           giveni={S\bibinitperiod}}}%
        {{hash=0508d45ce03b11237571e4919e8cfa08}{%
           family={Max},
           familyi={M\bibinitperiod},
           given={Stephanie},
           giveni={S\bibinitperiod}}}%
        {{hash=0180842ca4dde7937e004e9fbca913c2}{%
           family={Chen},
           familyi={C\bibinitperiod},
           given={Stephen},
           giveni={S\bibinitperiod}}}%
        {{hash=f6bb2fa63b48b0faba8e9415b69d76a2}{%
           family={Kehoe},
           familyi={K\bibinitperiod},
           given={Steve},
           giveni={S\bibinitperiod}}}%
        {{hash=dd565279a6b3ff997202996841f578cb}{%
           family={Satterfield},
           familyi={S\bibinitperiod},
           given={Steve},
           giveni={S\bibinitperiod}}}%
        {{hash=564ecaf17c00b623be2bcded3d1b7eb2}{%
           family={Govindaprasad},
           familyi={G\bibinitperiod},
           given={Sudarshan},
           giveni={S\bibinitperiod}}}%
        {{hash=9e28347d47434d68b2a810946e3485fd}{%
           family={Gupta},
           familyi={G\bibinitperiod},
           given={Sumit},
           giveni={S\bibinitperiod}}}%
        {{hash=700be19f5f7477ed2c36138289fbe5a5}{%
           family={Deng},
           familyi={D\bibinitperiod},
           given={Summer},
           giveni={S\bibinitperiod}}}%
        {{hash=30b4a0c2ecac8d883b69e3f004e55d27}{%
           family={Cho},
           familyi={C\bibinitperiod},
           given={Sungmin},
           giveni={S\bibinitperiod}}}%
        {{hash=68df331a61e3a351ce19811368fdd067}{%
           family={Virk},
           familyi={V\bibinitperiod},
           given={Sunny},
           giveni={S\bibinitperiod}}}%
        {{hash=7fcd1f73d9a52ad49a219a1e25a166ed}{%
           family={Subramanian},
           familyi={S\bibinitperiod},
           given={Suraj},
           giveni={S\bibinitperiod}}}%
        {{hash=9996a6cd3bf7158800249fdf7f52d3f3}{%
           family={Choudhury},
           familyi={C\bibinitperiod},
           given={Sy},
           giveni={S\bibinitperiod}}}%
        {{hash=c37fab903dfa8498dac5064d423441eb}{%
           family={Goldman},
           familyi={G\bibinitperiod},
           given={Sydney},
           giveni={S\bibinitperiod}}}%
        {{hash=cc980e5dc4f117cc7b9dc8e79b4e538d}{%
           family={Remez},
           familyi={R\bibinitperiod},
           given={Tal},
           giveni={T\bibinitperiod}}}%
        {{hash=a6692f2be771da60579cf3f160cc0be8}{%
           family={Glaser},
           familyi={G\bibinitperiod},
           given={Tamar},
           giveni={T\bibinitperiod}}}%
        {{hash=05eb2734ca563c20d2dfadefb2973ba3}{%
           family={Best},
           familyi={B\bibinitperiod},
           given={Tamara},
           giveni={T\bibinitperiod}}}%
        {{hash=ca4f7b89c24e08ebcf0109111421d8bb}{%
           family={Koehler},
           familyi={K\bibinitperiod},
           given={Thilo},
           giveni={T\bibinitperiod}}}%
        {{hash=1697c358b1d32c9b823a0f1883412819}{%
           family={Robinson},
           familyi={R\bibinitperiod},
           given={Thomas},
           giveni={T\bibinitperiod}}}%
        {{hash=0046d26b2b4052fa6b3b344a6f8126ee}{%
           family={Li},
           familyi={L\bibinitperiod},
           given={Tianhe},
           giveni={T\bibinitperiod}}}%
        {{hash=4088b3179b8029fdfca2b8a81ad73482}{%
           family={Zhang},
           familyi={Z\bibinitperiod},
           given={Tianjun},
           giveni={T\bibinitperiod}}}%
        {{hash=b7dcaf9fce703c51d1ac1b4f5afd2a29}{%
           family={Matthews},
           familyi={M\bibinitperiod},
           given={Tim},
           giveni={T\bibinitperiod}}}%
        {{hash=3ababcb228e63da7fe96b75788a47e25}{%
           family={Chou},
           familyi={C\bibinitperiod},
           given={Timothy},
           giveni={T\bibinitperiod}}}%
        {{hash=4cdbcf9741b50037d4d1273d510833ed}{%
           family={Shaked},
           familyi={S\bibinitperiod},
           given={Tzook},
           giveni={T\bibinitperiod}}}%
        {{hash=58f83a9c712937310623c47e5192e338}{%
           family={Vontimitta},
           familyi={V\bibinitperiod},
           given={Varun},
           giveni={V\bibinitperiod}}}%
        {{hash=a7372ea8eb2ce633a7fe3a6812880b3d}{%
           family={Ajayi},
           familyi={A\bibinitperiod},
           given={Victoria},
           giveni={V\bibinitperiod}}}%
        {{hash=a0e4f3fc01449993959fea1a010a6ae1}{%
           family={Montanez},
           familyi={M\bibinitperiod},
           given={Victoria},
           giveni={V\bibinitperiod}}}%
        {{hash=37a943a6ed693c46a1b8e75c5fa0ab11}{%
           family={Mohan},
           familyi={M\bibinitperiod},
           given={Vijai},
           giveni={V\bibinitperiod}}}%
        {{hash=19b1ff4a1c794ef2a3092e64edfd242e}{%
           family={Kumar},
           familyi={K\bibinitperiod},
           given={Vinay\bibnamedelima Satish},
           giveni={V\bibinitperiod\bibinitdelim S\bibinitperiod}}}%
        {{hash=9948579cb847e595860139cb4781700b}{%
           family={Mangla},
           familyi={M\bibinitperiod},
           given={Vishal},
           giveni={V\bibinitperiod}}}%
        {{hash=b224aff86fbef658cf05781db43ca56c}{%
           family={Ionescu},
           familyi={I\bibinitperiod},
           given={Vlad},
           giveni={V\bibinitperiod}}}%
        {{hash=a613ee99480541cdb9a75d1ab03866a4}{%
           family={Poenaru},
           familyi={P\bibinitperiod},
           given={Vlad},
           giveni={V\bibinitperiod}}}%
        {{hash=038e6532c4f02b7cbed0a1bb7745a108}{%
           family={Mihailescu},
           familyi={M\bibinitperiod},
           given={Vlad\bibnamedelima Tiberiu},
           giveni={V\bibinitperiod\bibinitdelim T\bibinitperiod}}}%
        {{hash=9c72a73cdab75ff72f0eb6bf5368d696}{%
           family={Ivanov},
           familyi={I\bibinitperiod},
           given={Vladimir},
           giveni={V\bibinitperiod}}}%
        {{hash=be6f1b6df7f1ddfafad18806238fa391}{%
           family={Li},
           familyi={L\bibinitperiod},
           given={Wei},
           giveni={W\bibinitperiod}}}%
        {{hash=062c436b41e44cf5ce96a8e379d3e1cf}{%
           family={Wang},
           familyi={W\bibinitperiod},
           given={Wenchen},
           giveni={W\bibinitperiod}}}%
        {{hash=e18a25a32880102eab726a6382408539}{%
           family={Jiang},
           familyi={J\bibinitperiod},
           given={Wenwen},
           giveni={W\bibinitperiod}}}%
        {{hash=eb72b2b69c876043447ddfcdef122961}{%
           family={Bouaziz},
           familyi={B\bibinitperiod},
           given={Wes},
           giveni={W\bibinitperiod}}}%
        {{hash=4766072c6524173c5b352a44b4e81ea2}{%
           family={Constable},
           familyi={C\bibinitperiod},
           given={Will},
           giveni={W\bibinitperiod}}}%
        {{hash=515c440104a8f1df12f8e45203cb9e39}{%
           family={Tang},
           familyi={T\bibinitperiod},
           given={Xiaocheng},
           giveni={X\bibinitperiod}}}%
        {{hash=cee3d25b43fc4c696b02624e1bb87885}{%
           family={Wu},
           familyi={W\bibinitperiod},
           given={Xiaojian},
           giveni={X\bibinitperiod}}}%
        {{hash=5986e7edcef792c198bc335834a6d754}{%
           family={Wang},
           familyi={W\bibinitperiod},
           given={Xiaolan},
           giveni={X\bibinitperiod}}}%
        {{hash=fefa2bfb82ea505f49180c1ca648280a}{%
           family={Wu},
           familyi={W\bibinitperiod},
           given={Xilun},
           giveni={X\bibinitperiod}}}%
        {{hash=5cc2d4e78c57c05664f761bd22543685}{%
           family={Gao},
           familyi={G\bibinitperiod},
           given={Xinbo},
           giveni={X\bibinitperiod}}}%
        {{hash=b54e3b30ac4444068135b13c8fe614c8}{%
           family={Kleinman},
           familyi={K\bibinitperiod},
           given={Yaniv},
           giveni={Y\bibinitperiod}}}%
        {{hash=bb01d83790d67da25dc003607f5c73ef}{%
           family={Chen},
           familyi={C\bibinitperiod},
           given={Yanjun},
           giveni={Y\bibinitperiod}}}%
        {{hash=e2da8a623ffb9d1af7c892950724d331}{%
           family={Hu},
           familyi={H\bibinitperiod},
           given={Ye},
           giveni={Y\bibinitperiod}}}%
        {{hash=d3a49a660fa8a6c8a93b5273a70eae29}{%
           family={Jia},
           familyi={J\bibinitperiod},
           given={Ye},
           giveni={Y\bibinitperiod}}}%
        {{hash=d1999e72113e85b3257e4c75e03265dc}{%
           family={Qi},
           familyi={Q\bibinitperiod},
           given={Ye},
           giveni={Y\bibinitperiod}}}%
        {{hash=7116d11eb4ba09bcaa84c94d2c55ce1f}{%
           family={Li},
           familyi={L\bibinitperiod},
           given={Yenda},
           giveni={Y\bibinitperiod}}}%
        {{hash=8a3b8dcf7b5b2a6961827725ee30c8bc}{%
           family={Zhang},
           familyi={Z\bibinitperiod},
           given={Yilin},
           giveni={Y\bibinitperiod}}}%
        {{hash=f5acec98b29ee91fa6b08b85a6a0adad}{%
           family={Zhang},
           familyi={Z\bibinitperiod},
           given={Ying},
           giveni={Y\bibinitperiod}}}%
        {{hash=b524686c039bdbe0e8cca661fca6b56c}{%
           family={Adi},
           familyi={A\bibinitperiod},
           given={Yossi},
           giveni={Y\bibinitperiod}}}%
        {{hash=e0933c3e694db6a888aaaf900cce2591}{%
           family={Nam},
           familyi={N\bibinitperiod},
           given={Youngjin},
           giveni={Y\bibinitperiod}}}%
        {{hash=0af2884fd29ac4bed46fc56851d95768}{%
           family={Yu},
           familyi={Y\bibinitperiod}}}%
        {{hash=957b05eb2d9bfaf59947e44a46c3c7b3}{%
           family={Wang},
           familyi={W\bibinitperiod}}}%
        {{hash=26500c0e7c5f37a79d71416c4c641ba2}{%
           family={Zhao},
           familyi={Z\bibinitperiod},
           given={Yu},
           giveni={Y\bibinitperiod}}}%
        {{hash=9f036802451721cb52c6a89a142c54de}{%
           family={Hao},
           familyi={H\bibinitperiod},
           given={Yuchen},
           giveni={Y\bibinitperiod}}}%
        {{hash=76f55ca261965fc4d519b5f859435a0b}{%
           family={Qian},
           familyi={Q\bibinitperiod},
           given={Yundi},
           giveni={Y\bibinitperiod}}}%
        {{hash=7b1b1d1305fa722b98ca9ba3492c1432}{%
           family={Li},
           familyi={L\bibinitperiod},
           given={Yunlu},
           giveni={Y\bibinitperiod}}}%
        {{hash=778e12ba06de6c9a9e60fdc7ad0d91c8}{%
           family={He},
           familyi={H\bibinitperiod},
           given={Yuzi},
           giveni={Y\bibinitperiod}}}%
        {{hash=02bbf2f73d4317c775ba326c6627ad25}{%
           family={Rait},
           familyi={R\bibinitperiod},
           given={Zach},
           giveni={Z\bibinitperiod}}}%
        {{hash=3f9535be511fd2fa346093e63b8e61a0}{%
           family={DeVito},
           familyi={D\bibinitperiod},
           given={Zachary},
           giveni={Z\bibinitperiod}}}%
        {{hash=3cd9976f573478e1d3885145b189c211}{%
           family={Rosnbrick},
           familyi={R\bibinitperiod},
           given={Zef},
           giveni={Z\bibinitperiod}}}%
        {{hash=598a1e3eb86f739e497ce17c7df7f863}{%
           family={Wen},
           familyi={W\bibinitperiod},
           given={Zhaoduo},
           giveni={Z\bibinitperiod}}}%
        {{hash=ebdd3afe60231d8067ed9e08883de58c}{%
           family={Yang},
           familyi={Y\bibinitperiod},
           given={Zhenyu},
           giveni={Z\bibinitperiod}}}%
        {{hash=a69e8330df4afe0adb0a8ed1f744195d}{%
           family={Zhao},
           familyi={Z\bibinitperiod},
           given={Zhiwei},
           giveni={Z\bibinitperiod}}}%
        {{hash=dfacbe26a77fba7d2303522d43096f47}{%
           family={Ma},
           familyi={M\bibinitperiod},
           given={Zhiyu},
           giveni={Z\bibinitperiod}}}%
      }
      \strng{namehash}{fd6db63ae85e705fb7f916f99c58faa2}
      \strng{fullhash}{8960c0d6de0c5c898d885796a71a0a19}
      \strng{bibnamehash}{fd6db63ae85e705fb7f916f99c58faa2}
      \strng{authorbibnamehash}{fd6db63ae85e705fb7f916f99c58faa2}
      \strng{authornamehash}{fd6db63ae85e705fb7f916f99c58faa2}
      \strng{authorfullhash}{8960c0d6de0c5c898d885796a71a0a19}
      \field{sortinit}{3}
      \field{sortinithash}{ad6fe7482ffbd7b9f99c9e8b5dccd3d7}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{abstract}{Modern artificial intelligence (AI) systems are powered by foundation models. This paper presents a new set of foundation models, called Llama 3. It is a herd of language models that natively support multilinguality, coding, reasoning, and tool usage. Our largest model is a dense Transformer with 405B parameters and a context window of up to 128K tokens. This paper presents an extensive empirical evaluation of Llama 3. We find that Llama 3 delivers comparable quality to leading language models such as GPT-4 on a plethora of tasks. We publicly release Llama 3, including pre-trained and post-trained versions of the 405B parameter language model and our Llama Guard 3 model for input and output safety. The paper also presents the results of experiments in which we integrate image, video, and speech capabilities into Llama 3 via a compositional approach. We observe this approach performs competitively with the state-of-the-art on image, video, and speech recognition tasks. The resulting models are not yet being broadly released as they are still under development.}
      \field{day}{23}
      \field{eprinttype}{arXiv}
      \field{howpublished}{arXiv: 2407.21783 (Only available as arXiv preprint)}
      \field{month}{11}
      \field{pubstate}{prepublished}
      \field{title}{The {{Llama}} 3 {{Herd}} of {{Models}}}
      \field{urlday}{19}
      \field{urlmonth}{3}
      \field{urlyear}{2025}
      \field{year}{2024}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \verb{doi}
      \verb 10.48550/arXiv.2407.21783
      \endverb
      \verb{eprint}
      \verb 2407.21783
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/PZG4PIHM/Grattafiori et al. - 2024 - The Llama 3 Herd of Models.pdf;/Users/landes/opt/var/zotero/storage/YJZ65JTT/2407.html
      \endverb
      \verb{urlraw}
      \verb http://arxiv.org/abs/2407.21783
      \endverb
      \verb{url}
      \verb http://arxiv.org/abs/2407.21783
      \endverb
      \keyw{Computer Science - Artificial Intelligence,Computer Science - Computation and Language,Computer Science - Computer Vision and Pattern Recognition}
    \endentry
    \entry{touvronLLaMAOpenEfficient2023}{misc}{}
      \name{author}{14}{}{%
        {{hash=a2a13fcd633ec70c55a7f3f4812afdcf}{%
           family={Touvron},
           familyi={T\bibinitperiod},
           given={Hugo},
           giveni={H\bibinitperiod}}}%
        {{hash=c641a91d616b6eda08cbbdca7b7eb186}{%
           family={Lavril},
           familyi={L\bibinitperiod},
           given={Thibaut},
           giveni={T\bibinitperiod}}}%
        {{hash=a32ece3bc966e7e88747e905158c9a6a}{%
           family={Izacard},
           familyi={I\bibinitperiod},
           given={Gautier},
           giveni={G\bibinitperiod}}}%
        {{hash=7222f9d76b0fff504f39e7c9c2a526be}{%
           family={Martinet},
           familyi={M\bibinitperiod},
           given={Xavier},
           giveni={X\bibinitperiod}}}%
        {{hash=08284515d256b832e9dba10a88af84f4}{%
           family={Lachaux},
           familyi={L\bibinitperiod},
           given={Marie-Anne},
           giveni={M\bibinithyphendelim A\bibinitperiod}}}%
        {{hash=1d29ae55d8d993d9f195b3c97bd34f7c}{%
           family={Lacroix},
           familyi={L\bibinitperiod},
           given={Timothée},
           giveni={T\bibinitperiod}}}%
        {{hash=e0d9a8657c1043f53c54f3f5a6ff305f}{%
           family={Rozière},
           familyi={R\bibinitperiod},
           given={Baptiste},
           giveni={B\bibinitperiod}}}%
        {{hash=78a420900f50a8470ad085fb05231bf6}{%
           family={Goyal},
           familyi={G\bibinitperiod},
           given={Naman},
           giveni={N\bibinitperiod}}}%
        {{hash=00ce63f55ae2ce6ea638e5f991996584}{%
           family={Hambro},
           familyi={H\bibinitperiod},
           given={Eric},
           giveni={E\bibinitperiod}}}%
        {{hash=5373a3313da61427121b3e9733df1ed2}{%
           family={Azhar},
           familyi={A\bibinitperiod},
           given={Faisal},
           giveni={F\bibinitperiod}}}%
        {{hash=a829e25f1d50c3545ed8e99f12890acc}{%
           family={Rodriguez},
           familyi={R\bibinitperiod},
           given={Aurelien},
           giveni={A\bibinitperiod}}}%
        {{hash=977d047821122d1c2e7aa855c30c8cf2}{%
           family={Joulin},
           familyi={J\bibinitperiod},
           given={Armand},
           giveni={A\bibinitperiod}}}%
        {{hash=ebdea2c3aa9f759075733b20dce6b873}{%
           family={Grave},
           familyi={G\bibinitperiod},
           given={Edouard},
           giveni={E\bibinitperiod}}}%
        {{hash=56509a94ba6cdaf0c71304d6cf806cee}{%
           family={Lample},
           familyi={L\bibinitperiod},
           given={Guillaume},
           giveni={G\bibinitperiod}}}%
      }
      \strng{namehash}{c237483431fea681283a37adbb23a59f}
      \strng{fullhash}{39aeaa201007bcb705db32778f923cb2}
      \strng{bibnamehash}{c237483431fea681283a37adbb23a59f}
      \strng{authorbibnamehash}{c237483431fea681283a37adbb23a59f}
      \strng{authornamehash}{c237483431fea681283a37adbb23a59f}
      \strng{authorfullhash}{39aeaa201007bcb705db32778f923cb2}
      \field{sortinit}{3}
      \field{sortinithash}{ad6fe7482ffbd7b9f99c9e8b5dccd3d7}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{shorttitle}
      \field{abstract}{We introduce LLaMA, a collection of foundation language models ranging from 7B to 65B parameters. We train our models on trillions of tokens, and show that it is possible to train state-of-the-art models using publicly available datasets exclusively, without resorting to proprietary and inaccessible datasets. In particular, LLaMA-13B outperforms GPT-3 (175B) on most benchmarks, and LLaMA-65B is competitive with the best models, Chinchilla-70B and PaLM-540B. We release all our models to the research community.}
      \field{day}{27}
      \field{eprintclass}{cs}
      \field{eprinttype}{arXiv}
      \field{howpublished}{arXiv: 2302.13971 (Only available as arXiv preprint)}
      \field{month}{2}
      \field{pubstate}{prepublished}
      \field{shorttitle}{{{LLaMA}}}
      \field{title}{{{LLaMA}}: {{Open}} and {{Efficient Foundation Language Models}}}
      \field{urlday}{12}
      \field{urlmonth}{5}
      \field{urlyear}{2023}
      \field{year}{2023}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \verb{doi}
      \verb 10.48550/arXiv.2302.13971
      \endverb
      \verb{eprint}
      \verb 2302.13971
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/SLVYZ6D2/Touvron et al. - 2023 - LLaMA Open and Efficient Foundation Language Mode.pdf;/Users/landes/opt/var/zotero/storage/U3ZREXRQ/2302.html
      \endverb
      \verb{urlraw}
      \verb http://arxiv.org/abs/2302.13971
      \endverb
      \verb{url}
      \verb http://arxiv.org/abs/2302.13971
      \endverb
      \keyw{Computer Science - Computation and Language}
    \endentry
    \entry{devlinBERTPretrainingDeep2019}{inproceedings}{}
      \name{author}{4}{}{%
        {{hash=13202969e372bc82318f9629cbdd199b}{%
           family={Devlin},
           familyi={D\bibinitperiod},
           given={Jacob},
           giveni={J\bibinitperiod}}}%
        {{hash=a45784fe7163b45f11d166564f5d24b6}{%
           family={Chang},
           familyi={C\bibinitperiod},
           given={Ming-Wei},
           giveni={M\bibinithyphendelim W\bibinitperiod}}}%
        {{hash=8dde73b4194f5bc4230c4808f3fc1534}{%
           family={Lee},
           familyi={L\bibinitperiod},
           given={Kenton},
           giveni={K\bibinitperiod}}}%
        {{hash=b92aa283415413bb8d2a1548716d0c7d}{%
           family={Toutanova},
           familyi={T\bibinitperiod},
           given={Kristina},
           giveni={K\bibinitperiod}}}%
      }
      \strng{namehash}{ad8e2e2a80d28ade21e86852b804fc9b}
      \strng{fullhash}{e8bccd48302a14eeba57d9dce2f49ef4}
      \strng{bibnamehash}{e8bccd48302a14eeba57d9dce2f49ef4}
      \strng{authorbibnamehash}{e8bccd48302a14eeba57d9dce2f49ef4}
      \strng{authornamehash}{ad8e2e2a80d28ade21e86852b804fc9b}
      \strng{authorfullhash}{e8bccd48302a14eeba57d9dce2f49ef4}
      \field{sortinit}{3}
      \field{sortinithash}{ad6fe7482ffbd7b9f99c9e8b5dccd3d7}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{shorttitle}
      \field{abstract}{We introduce a new language representation model called BERT, which stands for Bidirectional Encoder Representations from Transformers. Unlike recent language representation models (Peters et al., 2018a; Radford et al., 2018), BERT is designed to pretrain deep bidirectional representations from unlabeled text by jointly conditioning on both left and right context in all layers. As a result, the pre-trained BERT model can be finetuned with just one additional output layer to create state-of-the-art models for a wide range of tasks, such as question answering and language inference, without substantial taskspecific architecture modifications.}
      \field{booktitle}{Proceedings of the 2019 {{Conference}} of the {{North American Chapter}} of the {{Association}} for {{Computational Linguistics}}: {{Human Language Technologies}}, {{Volume}} 1 ({{Long}} and {{Short Papers}})}
      \field{day}{2}
      \field{eventtitle}{{{NAACL-HLT}}}
      \field{langid}{english}
      \field{month}{6}
      \field{shorttitle}{{{BERT}}}
      \field{title}{{{BERT}}: {{Pre-training}} of {{Deep Bidirectional Transformers}} for {{Language Understanding}}}
      \field{year}{2019}
      \field{dateera}{ce}
      \field{pages}{4171\bibrangedash 4186}
      \range{pages}{16}
      \verb{doi}
      \verb 10.18653/v1/N19-1423
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/W6HRVP8K/Devlin et al. - BERT Pre-training of Deep Bidirectional Transform.pdf
      \endverb
      \verb{urlraw}
      \verb https://aclanthology.org/N19-1423
      \endverb
      \verb{url}
      \verb https://aclanthology.org/N19-1423
      \endverb
    \endentry
    \entry{wangSelfConsistencyImprovesChain2022}{inproceedings}{}
      \name{author}{8}{}{%
        {{hash=27d22d8f05f44b47f7dcfe9b7fb85584}{%
           family={Wang},
           familyi={W\bibinitperiod},
           given={Xuezhi},
           giveni={X\bibinitperiod}}}%
        {{hash=61331a11b490f3d927555985facd25b3}{%
           family={Wei},
           familyi={W\bibinitperiod},
           given={Jason},
           giveni={J\bibinitperiod}}}%
        {{hash=fc76f5fb256da4d423554f8e629b4321}{%
           family={Schuurmans},
           familyi={S\bibinitperiod},
           given={Dale},
           giveni={D\bibinitperiod}}}%
        {{hash=c636f146591d51579a8119b777394878}{%
           family={Le},
           familyi={L\bibinitperiod},
           given={Quoc\bibnamedelima V.},
           giveni={Q\bibinitperiod\bibinitdelim V\bibinitperiod}}}%
        {{hash=594b2be737e055817db9ad276b6bf05a}{%
           family={Chi},
           familyi={C\bibinitperiod},
           given={Ed\bibnamedelima H.},
           giveni={E\bibinitperiod\bibinitdelim H\bibinitperiod}}}%
        {{hash=a2da348cbbad750c6fe76dda9c35ffcd}{%
           family={Narang},
           familyi={N\bibinitperiod},
           given={Sharan},
           giveni={S\bibinitperiod}}}%
        {{hash=fd55b702c004c13506e70bb76a4e987c}{%
           family={Chowdhery},
           familyi={C\bibinitperiod},
           given={Aakanksha},
           giveni={A\bibinitperiod}}}%
        {{hash=797f9a226fd7356db5edc6feba1a0e87}{%
           family={Zhou},
           familyi={Z\bibinitperiod},
           given={Denny},
           giveni={D\bibinitperiod}}}%
      }
      \list{location}{1}{%
        {Kigali Rwanda}%
      }
      \list{publisher}{1}{%
        {Advances in neural information processing systems}%
      }
      \strng{namehash}{1148fc4318cebce09c5c6a4181848a72}
      \strng{fullhash}{72c0811bfd1a7d60452a3aba1fe60b98}
      \strng{bibnamehash}{1148fc4318cebce09c5c6a4181848a72}
      \strng{authorbibnamehash}{1148fc4318cebce09c5c6a4181848a72}
      \strng{authornamehash}{1148fc4318cebce09c5c6a4181848a72}
      \strng{authorfullhash}{72c0811bfd1a7d60452a3aba1fe60b98}
      \field{extraname}{2}
      \field{sortinit}{3}
      \field{sortinithash}{ad6fe7482ffbd7b9f99c9e8b5dccd3d7}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{abstract}{Chain-of-thought prompting combined with pretrained large language models has achieved encouraging results on complex reasoning tasks. In this paper, we propose a new decoding strategy, self-consistency, to replace the naive greedy decoding used in chain-of-thought prompting. It first samples a diverse set of reasoning paths instead of only taking the greedy one, and then selects the most consistent answer by marginalizing out all possible reasoning paths. Self-consistency leverages the intuition that a complex reasoning problem typically admits multiple different ways of thinking leading to its unique correct answer. Our extensive empirical evaluation shows that self-consistency boosts the performance of chain-of-thought prompting with a striking margin on a range of popular arithmetic and commonsense reasoning benchmarks, including GSM8K (+17.9\%), SVAMP (+11.0\%), AQuA (+12.2\%), StrategyQA (+6.4\%) and ARC-challenge (+3.9\%).}
      \field{booktitle}{Proceedings of the {{Eleventh International Conference}} on {{Learning Representations}}}
      \field{day}{29}
      \field{eventtitle}{{{ICLR}}}
      \field{langid}{english}
      \field{month}{9}
      \field{title}{Self-{{Consistency Improves Chain}} of {{Thought Reasoning}} in {{Language Models}}}
      \field{urlday}{3}
      \field{urlmonth}{3}
      \field{urlyear}{2025}
      \field{year}{2022}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/5FGX8IRZ/Wang et al. - 2022 - Self-Consistency Improves Chain of Thought Reasoning in Language Models Slides.pdf;/Users/landes/opt/var/zotero/storage/EWECTD92/Wang et al. - 2022 - Self-Consistency Improves Chain of Thought Reasoning in Language Models.pdf
      \endverb
      \verb{urlraw}
      \verb https://openreview.net/pdf?id=1PL1NIMMrw
      \endverb
      \verb{url}
      \verb https://openreview.net/pdf?id=1PL1NIMMrw
      \endverb
    \endentry
    \entry{sechidisStratificationMultilabelData2011}{incollection}{}
      \name{author}{3}{}{%
        {{hash=ad5a19fa24860e83c0622bf6b9193b36}{%
           family={Sechidis},
           familyi={S\bibinitperiod},
           given={Konstantinos},
           giveni={K\bibinitperiod}}}%
        {{hash=4f0d141cf0fe25aef8af5a28df702ef7}{%
           family={Tsoumakas},
           familyi={T\bibinitperiod},
           given={Grigorios},
           giveni={G\bibinitperiod}}}%
        {{hash=a5f197c3ac3debe11a3bc412d8b5923b}{%
           family={Vlahavas},
           familyi={V\bibinitperiod},
           given={Ioannis},
           giveni={I\bibinitperiod}}}%
      }
      \name{editor}{4}{}{%
        {{hash=a3b0e05489b14b7e94e12640d41a9e3b}{%
           family={Gunopulos},
           familyi={G\bibinitperiod},
           given={Dimitrios},
           giveni={D\bibinitperiod}}}%
        {{hash=ee42cfed2ff3020233d2de97c356eaee}{%
           family={Hofmann},
           familyi={H\bibinitperiod},
           given={Thomas},
           giveni={T\bibinitperiod}}}%
        {{hash=91c6d89aff69b05661903e935a3e0403}{%
           family={Malerba},
           familyi={M\bibinitperiod},
           given={Donato},
           giveni={D\bibinitperiod}}}%
        {{hash=a325a5cf58bcb9d372a4bcab568fc2c5}{%
           family={Vazirgiannis},
           familyi={V\bibinitperiod},
           given={Michalis},
           giveni={M\bibinitperiod}}}%
      }
      \list{location}{1}{%
        {Berlin, Heidelberg}%
      }
      \list{publisher}{1}{%
        {Springer Berlin Heidelberg}%
      }
      \strng{namehash}{891438ab01c40552c4300c632afaa84c}
      \strng{fullhash}{ba94512c201d66edda63e4971aa95e5b}
      \strng{bibnamehash}{ba94512c201d66edda63e4971aa95e5b}
      \strng{authorbibnamehash}{ba94512c201d66edda63e4971aa95e5b}
      \strng{authornamehash}{891438ab01c40552c4300c632afaa84c}
      \strng{authorfullhash}{ba94512c201d66edda63e4971aa95e5b}
      \strng{editorbibnamehash}{37b4835ec48b9e6ea164020c8485890f}
      \strng{editornamehash}{a01ae49d072e08e1979e0c5612ee04be}
      \strng{editorfullhash}{37b4835ec48b9e6ea164020c8485890f}
      \field{sortinit}{5}
      \field{sortinithash}{20e9b4b0b173788c5dace24730f47d8c}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{abstract}{Stratified sampling is a sampling method that takes into account the existence of disjoint groups within a population and produces samples where the proportion of these groups is maintained. In single-label classification tasks, groups are differentiated based on the value of the target variable. In multi-label learning tasks, however, where there are multiple target variables, it is not clear how stratified sampling could/should be performed. This paper investigates stratification in the multi-label data context. It considers two stratification methods for multi-label data and empirically compares them along with random sampling on a number of datasets and based on a number of evaluation criteria. The results reveal some interesting conclusions with respect to the utility of each method for particular types of multi-label datasets.}
      \field{booktitle}{Machine {{Learning}} and {{Knowledge Discovery}} in {{Databases}}}
      \field{isbn}{978-3-642-23807-9 978-3-642-23808-6}
      \field{langid}{english}
      \field{title}{On the {{Stratification}} of {{Multi-label Data}}}
      \field{urlday}{20}
      \field{urlmonth}{3}
      \field{urlyear}{2024}
      \field{volume}{6913}
      \field{year}{2011}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \field{pages}{145\bibrangedash 158}
      \range{pages}{14}
      \verb{doi}
      \verb 10.1007/978-3-642-23808-6_10
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/295PSRL6/Sechidis et al. - 2011 - On the Stratification of Multi-label Data.pdf
      \endverb
      \verb{urlraw}
      \verb http://link.springer.com/10.1007/978-3-642-23808-6_10
      \endverb
      \verb{url}
      \verb http://link.springer.com/10.1007/978-3-642-23808-6_10
      \endverb
    \endentry
    \entry{huLoRALowRankAdaptation2021a}{inproceedings}{}
      \name{author}{8}{}{%
        {{hash=e6a95d07b8ae7f14e4eb777c6980a059}{%
           family={Hu},
           familyi={H\bibinitperiod},
           given={Edward\bibnamedelima J.},
           giveni={E\bibinitperiod\bibinitdelim J\bibinitperiod}}}%
        {{hash=1701c0f05662e92cf52cfc8c16437496}{%
           family={Shen},
           familyi={S\bibinitperiod},
           given={Yelong},
           giveni={Y\bibinitperiod}}}%
        {{hash=ab0fdbc1586103dda7ac5e0852e5b2c3}{%
           family={Wallis},
           familyi={W\bibinitperiod},
           given={Phillip},
           giveni={P\bibinitperiod}}}%
        {{hash=eaa5cc98b7f19b4ce07c832213a13b9d}{%
           family={Allen-Zhu},
           familyi={A\bibinithyphendelim Z\bibinitperiod},
           given={Zeyuan},
           giveni={Z\bibinitperiod}}}%
        {{hash=0d2c91b24f885b22d373a892a768abc8}{%
           family={Li},
           familyi={L\bibinitperiod},
           given={Yuanzhi},
           giveni={Y\bibinitperiod}}}%
        {{hash=b654b88ecd4c3ff1ea29da275bce701c}{%
           family={Wang},
           familyi={W\bibinitperiod},
           given={Shean},
           giveni={S\bibinitperiod}}}%
        {{hash=55f210233ac686af68eba11a97bd84e2}{%
           family={Wang},
           familyi={W\bibinitperiod},
           given={Lu},
           giveni={L\bibinitperiod}}}%
        {{hash=05d71a9c5e7ac79222e01a55af0ccb93}{%
           family={Chen},
           familyi={C\bibinitperiod},
           given={Weizhu},
           giveni={W\bibinitperiod}}}%
      }
      \strng{namehash}{d775178c34083951ab1e07df578582c3}
      \strng{fullhash}{08f4b49735d5d145be00bc9c07f38975}
      \strng{bibnamehash}{d775178c34083951ab1e07df578582c3}
      \strng{authorbibnamehash}{d775178c34083951ab1e07df578582c3}
      \strng{authornamehash}{d775178c34083951ab1e07df578582c3}
      \strng{authorfullhash}{08f4b49735d5d145be00bc9c07f38975}
      \field{sortinit}{6}
      \field{sortinithash}{b33bc299efb3c36abec520a4c896a66d}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{shorttitle}
      \field{abstract}{An important paradigm of natural language processing consists of large-scale pre-training on general domain data and adaptation to particular tasks or domains. As we pre-train larger models, full fine-tuning, which retrains all model parameters, becomes less feasible. Using GPT-3 175B as an example -- deploying independent instances of fine-tuned models, each with 175B parameters, is prohibitively expensive. We propose Low-Rank Adaptation, or LoRA, which freezes the pre-trained model weights and injects trainable rank decomposition matrices into each layer of the Transformer architecture, greatly reducing the number of trainable parameters for downstream tasks. Compared to GPT-3 175B fine-tuned with Adam, LoRA can reduce the number of trainable parameters by a factor of 10,000 and the GPU memory requirement by a factor of 3. LoRA performs on-par or better than fine-tuning in model quality on RoBERTa, DeBERTa, GPT-2, and GPT-3, despite having fewer trainable parameters, a higher training throughput, and, unlike adapters, no additional inference latency. We also provide an empirical investigation into rank-deficiency in language model adaptation, which sheds light on the efficacy of LoRA. We release a package that facilitates the integration of LoRA with PyTorch models and provide our implementations and model checkpoints for RoBERTa, DeBERTa, and GPT-2 at https://github.com/microsoft/LoRA.}
      \field{day}{6}
      \field{eventtitle}{International {{Conference}} on {{Learning Representations}}}
      \field{langid}{english}
      \field{month}{10}
      \field{shorttitle}{{{LoRA}}}
      \field{title}{{{LoRA}}: {{Low-Rank Adaptation}} of {{Large Language Models}}}
      \field{urlday}{24}
      \field{urlmonth}{1}
      \field{urlyear}{2025}
      \field{year}{2021}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/T35PHX5Q/Hu et al. - 2021 - LoRA Low-Rank Adaptation of Large Language Models.pdf
      \endverb
      \verb{urlraw}
      \verb https://openreview.net/forum?id=nZeVKeeFYf9
      \endverb
      \verb{url}
      \verb https://openreview.net/forum?id=nZeVKeeFYf9
      \endverb
    \endentry
    \entry{aghajanyanIntrinsicDimensionalityExplains2021}{inproceedings}{}
      \name{author}{3}{}{%
        {{hash=f7b92d087e7f9a78f52107b58c9297c0}{%
           family={Aghajanyan},
           familyi={A\bibinitperiod},
           given={Armen},
           giveni={A\bibinitperiod}}}%
        {{hash=545cf31b67044795c5772570c35f71f0}{%
           family={Gupta},
           familyi={G\bibinitperiod},
           given={Sonal},
           giveni={S\bibinitperiod}}}%
        {{hash=1dbd3a5b42828fb2cebd7786488ba425}{%
           family={Zettlemoyer},
           familyi={Z\bibinitperiod},
           given={Luke},
           giveni={L\bibinitperiod}}}%
      }
      \name{editor}{4}{}{%
        {{hash=9d8c366afd7f948820f05d7fe6206c28}{%
           family={Zong},
           familyi={Z\bibinitperiod},
           given={Chengqing},
           giveni={C\bibinitperiod}}}%
        {{hash=61e00ed0c44b8bddb9077a74a4ac1167}{%
           family={Xia},
           familyi={X\bibinitperiod},
           given={Fei},
           giveni={F\bibinitperiod}}}%
        {{hash=318a797cfb1e6f8da35b79287d226780}{%
           family={Li},
           familyi={L\bibinitperiod},
           given={Wenjie},
           giveni={W\bibinitperiod}}}%
        {{hash=6fe24dce481a67e247581d4b20435709}{%
           family={Navigli},
           familyi={N\bibinitperiod},
           given={Roberto},
           giveni={R\bibinitperiod}}}%
      }
      \list{location}{1}{%
        {Online}%
      }
      \list{publisher}{1}{%
        {Association for Computational Linguistics}%
      }
      \strng{namehash}{883b8672233d92d7b5055910f6f593f8}
      \strng{fullhash}{aff1845554e51b4987c266a079849a2b}
      \strng{bibnamehash}{aff1845554e51b4987c266a079849a2b}
      \strng{authorbibnamehash}{aff1845554e51b4987c266a079849a2b}
      \strng{authornamehash}{883b8672233d92d7b5055910f6f593f8}
      \strng{authorfullhash}{aff1845554e51b4987c266a079849a2b}
      \strng{editorbibnamehash}{7c3dda83a9d34ca480a8d30a423f8916}
      \strng{editornamehash}{4058c5286e5d51b02c73d306e7a9473d}
      \strng{editorfullhash}{7c3dda83a9d34ca480a8d30a423f8916}
      \field{sortinit}{6}
      \field{sortinithash}{b33bc299efb3c36abec520a4c896a66d}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{abstract}{Although pretrained language models can be fine-tuned to produce state-of-the-art results for a very wide range of language understanding tasks, the dynamics of this process are not well understood, especially in the low data regime. Why can we use relatively vanilla gradient descent algorithms (e.g., without strong regularization) to tune a model with hundreds of millions of parameters on datasets with only hundreds or thousands of labeled examples? In this paper, we argue that analyzing fine-tuning through the lens of intrinsic dimension provides us with empirical and theoretical intuitions to explain this remarkable phenomenon. We empirically show that common pre-trained models have a very low intrinsic dimension; in other words, there exists a low dimension reparameterization that is as effective for fine-tuning as the full parameter space. For example, by optimizing only 200 trainable parameters randomly projected back into the full space, we can tune a RoBERTa model to achieve 90\% of the full parameter performance levels on MRPC. Furthermore, we empirically show that pre-training implicitly minimizes intrinsic dimension and, perhaps surprisingly, larger models tend to have lower intrinsic dimension after a fixed number of pre-training updates, at least in part explaining their extreme effectiveness. Lastly, we connect intrinsic dimensionality with low dimensional task representations and compression based generalization bounds to provide intrinsic-dimension-based generalization bounds that are independent of the full parameter count.}
      \field{booktitle}{Proceedings of the 59th {{Annual Meeting}} of the {{Association}} for {{Computational Linguistics}} and the 11th {{International Joint Conference}} on {{Natural Language Processing}} ({{Volume}} 1: {{Long Papers}})}
      \field{eventtitle}{{{ACL-IJCNLP}} 2021}
      \field{month}{8}
      \field{title}{Intrinsic {{Dimensionality Explains}} the {{Effectiveness}} of {{Language Model Fine-Tuning}}}
      \field{urlday}{24}
      \field{urlmonth}{1}
      \field{urlyear}{2025}
      \field{year}{2021}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \field{pages}{7319\bibrangedash 7328}
      \range{pages}{10}
      \verb{doi}
      \verb 10.18653/v1/2021.acl-long.568
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/YSW6QCLP/Aghajanyan et al. - 2021 - Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuning.pdf
      \endverb
      \verb{urlraw}
      \verb https://aclanthology.org/2021.acl-long.568/
      \endverb
      \verb{url}
      \verb https://aclanthology.org/2021.acl-long.568/
      \endverb
    \endentry
    \entry{kanayamaIncorporatingSyntaxLexical2024}{inproceedings}{}
      \name{author}{4}{}{%
        {{hash=55663b9b52c59f45f68a6091921b1323}{%
           family={Kanayama},
           familyi={K\bibinitperiod},
           given={Hiroshi},
           giveni={H\bibinitperiod}}}%
        {{hash=f0e7d180081df6c4c59c600f7c044474}{%
           family={Zhao},
           familyi={Z\bibinitperiod},
           given={Yang},
           giveni={Y\bibinitperiod}}}%
        {{hash=6c206c35b8d1cb0c8097bbe40c904cb9}{%
           family={Iwamoto},
           familyi={I\bibinitperiod},
           given={Ran},
           giveni={R\bibinitperiod}}}%
        {{hash=c0b859b764270e6460bea65f56c6d04b}{%
           family={Ohko},
           familyi={O\bibinitperiod},
           given={Takuya},
           giveni={T\bibinitperiod}}}%
      }
      \list{location}{2}{%
        {Bangkok, Thailand}%
        {virtual meeting}%
      }
      \list{publisher}{1}{%
        {Association for Computational Linguistics}%
      }
      \strng{namehash}{e5098c3314a7a9ae69a20cf16deeb6c2}
      \strng{fullhash}{d5feb189a4d3fcb3ced0dcdf939e0475}
      \strng{bibnamehash}{d5feb189a4d3fcb3ced0dcdf939e0475}
      \strng{authorbibnamehash}{d5feb189a4d3fcb3ced0dcdf939e0475}
      \strng{authornamehash}{e5098c3314a7a9ae69a20cf16deeb6c2}
      \strng{authorfullhash}{d5feb189a4d3fcb3ced0dcdf939e0475}
      \field{sortinit}{6}
      \field{sortinithash}{b33bc299efb3c36abec520a4c896a66d}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{abstract}{This paper exploits a sentiment extractor supported by syntactic and lexical resources to enhance multilingual sentiment classification solved through the generative approach, without retraining LLMs. By adding external information of words and phrases that have positive/negative polarities, the multilingual sentiment classification error was reduced by up to 33 points, and the combination of two approaches performed best especially in highperforming pairs of LLMs and languages.}
      \field{booktitle}{Findings of the {{Association}} for {{Computational Linguistics ACL}} 2024}
      \field{eventtitle}{Findings of the {{Association}} for {{Computational Linguistics ACL}} 2024}
      \field{langid}{english}
      \field{title}{Incorporating {{Syntax}} and {{Lexical Knowledge}} to {{Multilingual Sentiment Classification}} on {{Large Language Models}}}
      \field{urlday}{12}
      \field{urlmonth}{2}
      \field{urlyear}{2025}
      \field{year}{2024}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \field{pages}{4810\bibrangedash 4817}
      \range{pages}{8}
      \verb{doi}
      \verb 10.18653/v1/2024.findings-acl.286
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/72VYAZK2/Kanayama et al. - 2024 - Incorporating Syntax and Lexical Knowledge to Multilingual Sentiment Classification on Large Languag.pdf
      \endverb
      \verb{urlraw}
      \verb https://aclanthology.org/2024.findings-acl.286
      \endverb
      \verb{url}
      \verb https://aclanthology.org/2024.findings-acl.286
      \endverb
    \endentry
    \entry{liuRoBERTaRobustlyOptimized2019}{misc}{}
      \name{author}{10}{}{%
        {{hash=94530daf7a9db4abe89cfb22935373eb}{%
           family={Liu},
           familyi={L\bibinitperiod},
           given={Yinhan},
           giveni={Y\bibinitperiod}}}%
        {{hash=b13aa2bad5258fa5ef7a733f2d305a49}{%
           family={Ott},
           familyi={O\bibinitperiod},
           given={Myle},
           giveni={M\bibinitperiod}}}%
        {{hash=78a420900f50a8470ad085fb05231bf6}{%
           family={Goyal},
           familyi={G\bibinitperiod},
           given={Naman},
           giveni={N\bibinitperiod}}}%
        {{hash=e483b52ce2cd3ba2fd08e7bf4fef4ff0}{%
           family={Du},
           familyi={D\bibinitperiod},
           given={Jingfei},
           giveni={J\bibinitperiod}}}%
        {{hash=e5bfa941bcdbfecb5f3e42bb6ac9eb5f}{%
           family={Joshi},
           familyi={J\bibinitperiod},
           given={Mandar},
           giveni={M\bibinitperiod}}}%
        {{hash=aed188db3fc6855ac5666aa14e04a3bb}{%
           family={Chen},
           familyi={C\bibinitperiod},
           given={Danqi},
           giveni={D\bibinitperiod}}}%
        {{hash=038965e189161e03f6255a4278c280a1}{%
           family={Levy},
           familyi={L\bibinitperiod},
           given={Omer},
           giveni={O\bibinitperiod}}}%
        {{hash=c97f53fdeeb04c28de19e3324cb4bc0a}{%
           family={Lewis},
           familyi={L\bibinitperiod},
           given={Mike},
           giveni={M\bibinitperiod}}}%
        {{hash=1dbd3a5b42828fb2cebd7786488ba425}{%
           family={Zettlemoyer},
           familyi={Z\bibinitperiod},
           given={Luke},
           giveni={L\bibinitperiod}}}%
        {{hash=9b97236dd2d1a104fc5cf9660dd5582e}{%
           family={Stoyanov},
           familyi={S\bibinitperiod},
           given={Veselin},
           giveni={V\bibinitperiod}}}%
      }
      \strng{namehash}{bbac34a28b7aba5cd543f7c72e0d987d}
      \strng{fullhash}{7579c765ce38b2c34c8f9768ec3bc342}
      \strng{bibnamehash}{bbac34a28b7aba5cd543f7c72e0d987d}
      \strng{authorbibnamehash}{bbac34a28b7aba5cd543f7c72e0d987d}
      \strng{authornamehash}{bbac34a28b7aba5cd543f7c72e0d987d}
      \strng{authorfullhash}{7579c765ce38b2c34c8f9768ec3bc342}
      \field{sortinit}{6}
      \field{sortinithash}{b33bc299efb3c36abec520a4c896a66d}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{shorttitle}
      \field{abstract}{Language model pretraining has led to significant performance gains but careful comparison between different approaches is challenging. Training is computationally expensive, often done on private datasets of different sizes, and, as we will show, hyperparameter choices have significant impact on the final results. We present a replication study of BERT pretraining (Devlin et al., 2019) that carefully measures the impact of many key hyperparameters and training data size. We find that BERT was significantly undertrained, and can match or exceed the performance of every model published after it. Our best model achieves state-of-the-art results on GLUE, RACE and SQuAD. These results highlight the importance of previously overlooked design choices, and raise questions about the source of recently reported improvements. We release our models and code.}
      \field{day}{26}
      \field{eprintclass}{cs}
      \field{eprinttype}{arXiv}
      \field{howpublished}{arXiv: 1907.11692 (Only available as arXiv preprint)}
      \field{month}{7}
      \field{shorttitle}{{{RoBERTa}}}
      \field{title}{{{RoBERTa}}: {{A Robustly Optimized BERT Pretraining Approach}}}
      \field{urlday}{24}
      \field{urlmonth}{6}
      \field{urlyear}{2021}
      \field{year}{2019}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \verb{eprint}
      \verb 1907.11692
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/P2MV4DQB/Liu et al. - 2019 - RoBERTa A Robustly Optimized BERT Pretraining App.pdf;/Users/landes/opt/var/zotero/storage/2GJRHQLI/1907.html
      \endverb
      \verb{urlraw}
      \verb http://arxiv.org/abs/1907.11692
      \endverb
      \verb{url}
      \verb http://arxiv.org/abs/1907.11692
      \endverb
      \keyw{Computer Science - Computation and Language}
    \endentry
    \entry{montaniExplosionSpaCyV3722023}{software}{}
      \name{author}{6}{}{%
        {{hash=47c9fa7dcc4eb3484a88f4bb42655895}{%
           family={Montani},
           familyi={M\bibinitperiod},
           given={Ines},
           giveni={I\bibinitperiod}}}%
        {{hash=31cf0cd70714219d39b46b0f8aae95f9}{%
           family={Honnibal},
           familyi={H\bibinitperiod},
           given={Matthew},
           giveni={M\bibinitperiod}}}%
        {{hash=31cf0cd70714219d39b46b0f8aae95f9}{%
           family={Honnibal},
           familyi={H\bibinitperiod},
           given={Matthew},
           giveni={M\bibinitperiod}}}%
        {{hash=536eccdf07a1897181ba997c05a422d4}{%
           family={Boyd},
           familyi={B\bibinitperiod},
           given={Adriane},
           giveni={A\bibinitperiod}}}%
        {{hash=53ed9c382136c29aab695a2f663001a0}{%
           family={Landeghem},
           familyi={L\bibinitperiod},
           given={Sofie\bibnamedelima Van},
           giveni={S\bibinitperiod\bibinitdelim V\bibinitperiod}}}%
        {{hash=0170a06ea692c40122ad0e00860c120e}{%
           family={Peters},
           familyi={P\bibinitperiod},
           given={Henning},
           giveni={H\bibinitperiod}}}%
      }
      \list{organization}{1}{%
        {Zenodo}%
      }
      \strng{namehash}{7affdf13b3125b4ad8c38fc756783180}
      \strng{fullhash}{7be19e89c2de0cd035626311e2e97790}
      \strng{bibnamehash}{7affdf13b3125b4ad8c38fc756783180}
      \strng{authorbibnamehash}{7affdf13b3125b4ad8c38fc756783180}
      \strng{authornamehash}{7affdf13b3125b4ad8c38fc756783180}
      \strng{authorfullhash}{7be19e89c2de0cd035626311e2e97790}
      \field{sortinit}{6}
      \field{sortinithash}{b33bc299efb3c36abec520a4c896a66d}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{shorttitle}
      \field{abstract}{✨ New features and improvements Update \_\_all\_\_ fields (\#13063). 🔴 Bug fixes \#13035: Remove Pathy requirement. \#13053: Restore spacy.cli.project API. \#13057: Support Any comparisons for Token and Span. 📖 Documentation and examples Many updates for spacy-llm including Azure OpenAI, PaLM, and Mistral support. Various documentation corrections. 👥 Contributors @adrianeboyd, @honnibal, @ines, @rmitsch, @svlandeg}
      \field{day}{16}
      \field{month}{10}
      \field{shorttitle}{Explosion/{{spaCy}}}
      \field{title}{Explosion/{{spaCy}}: V3.7.2: {{Fixes}} for {{APIs}} and Requirements}
      \field{urlday}{21}
      \field{urlmonth}{3}
      \field{urlyear}{2025}
      \field{version}{v3.7.2}
      \field{year}{2023}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \verb{doi}
      \verb 10.5281/zenodo.10009823
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/G6BSCU9D/10009823.html
      \endverb
      \verb{urlraw}
      \verb https://zenodo.org/records/10009823
      \endverb
      \verb{url}
      \verb https://zenodo.org/records/10009823
      \endverb
    \endentry
    \entry{neumannScispaCyFastRobust2019}{inproceedings}{}
      \name{author}{4}{}{%
        {{hash=93f95e4f65833691b9a15cbe2791e2df}{%
           family={Neumann},
           familyi={N\bibinitperiod},
           given={Mark},
           giveni={M\bibinitperiod}}}%
        {{hash=794e369f15e51ab4d928f7d736f5d9d1}{%
           family={King},
           familyi={K\bibinitperiod},
           given={Daniel},
           giveni={D\bibinitperiod}}}%
        {{hash=ad932527c4d078ff96e5f0b189c66c61}{%
           family={Beltagy},
           familyi={B\bibinitperiod},
           given={Iz},
           giveni={I\bibinitperiod}}}%
        {{hash=457d1a8416f68e512111e2072e02b9eb}{%
           family={Ammar},
           familyi={A\bibinitperiod},
           given={Waleed},
           giveni={W\bibinitperiod}}}%
      }
      \list{location}{1}{%
        {Florence, Italy}%
      }
      \list{publisher}{1}{%
        {Association for Computational Linguistics}%
      }
      \strng{namehash}{0d6196ef887ec04b78560e7226d8863c}
      \strng{fullhash}{e3749eaace5f848458d81ae0c1cc731e}
      \strng{bibnamehash}{e3749eaace5f848458d81ae0c1cc731e}
      \strng{authorbibnamehash}{e3749eaace5f848458d81ae0c1cc731e}
      \strng{authornamehash}{0d6196ef887ec04b78560e7226d8863c}
      \strng{authorfullhash}{e3749eaace5f848458d81ae0c1cc731e}
      \field{sortinit}{6}
      \field{sortinithash}{b33bc299efb3c36abec520a4c896a66d}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{shorttitle}
      \field{abstract}{Despite recent advances in natural language processing, many statistical models for processing text perform extremely poorly under domain shift. Processing biomedical and clinical text is a critically important application area of natural language processing, for which there are few robust, practical, publicly available models. This paper describes scispaCy, a new Python library and models for practical biomedical/scientific text processing, which heavily leverages the spaCy library. We detail the performance of two packages of models released in scispaCy and demonstrate their robustness on several tasks and datasets. Models and code are available at https:// allenai.github.io/scispacy/.}
      \field{booktitle}{Proceedings of the 18th {{BioNLP Workshop}} and {{Shared Task}}}
      \field{eventtitle}{Proceedings of the 18th {{BioNLP Workshop}} and {{Shared Task}}}
      \field{langid}{english}
      \field{shorttitle}{{{ScispaCy}}}
      \field{title}{{{ScispaCy}}: {{Fast}} and {{Robust Models}} for {{Biomedical Natural Language Processing}}}
      \field{urlday}{2}
      \field{urlmonth}{8}
      \field{urlyear}{2021}
      \field{year}{2019}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \field{pages}{319\bibrangedash 327}
      \range{pages}{9}
      \verb{doi}
      \verb 10.18653/v1/W19-5034
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/GIN44UZG/Neumann et al. - 2019 - ScispaCy Fast and Robust Models for Biomedical Na.pdf
      \endverb
      \verb{urlraw}
      \verb https://www.aclweb.org/anthology/W19-5034
      \endverb
      \verb{url}
      \verb https://www.aclweb.org/anthology/W19-5034
      \endverb
    \endentry
    \entry{bodenreiderUnifiedMedicalLanguage2004}{article}{}
      \name{author}{1}{}{%
        {{hash=0bd9aac096a3ead0e9ea30128cb48c46}{%
           family={Bodenreider},
           familyi={B\bibinitperiod},
           given={Olivier},
           giveni={O\bibinitperiod}}}%
      }
      \strng{namehash}{0bd9aac096a3ead0e9ea30128cb48c46}
      \strng{fullhash}{0bd9aac096a3ead0e9ea30128cb48c46}
      \strng{bibnamehash}{0bd9aac096a3ead0e9ea30128cb48c46}
      \strng{authorbibnamehash}{0bd9aac096a3ead0e9ea30128cb48c46}
      \strng{authornamehash}{0bd9aac096a3ead0e9ea30128cb48c46}
      \strng{authorfullhash}{0bd9aac096a3ead0e9ea30128cb48c46}
      \field{sortinit}{7}
      \field{sortinithash}{108d0be1b1bee9773a1173443802c0a3}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{shorttitle}
      \field{abstract}{The Unified Medical Language System ( http://umlsks.nlm.nih.gov ) is a repository of biomedical vocabularies developed by the US National Library of Medicine. The UMLS integrates over 2 million names for some 900 000 concepts from more than 60 families of biomedical vocabularies, as well as 12 million relations among these concepts. Vocabularies integrated in the UMLS Metathesaurus include the NCBI taxonomy, Gene Ontology, the Medical Subject Headings (MeSH), OMIM and the Digital Anatomist Symbolic Knowledge Base. UMLS concepts are not only inter‐related, but may also be linked to external resources such as GenBank. In addition to data, the UMLS includes tools for customizing the Metathesaurus (MetamorphoSys), for generating lexical variants of concept names (lvg) and for extracting UMLS concepts from text (MetaMap). The UMLS knowledge sources are updated quarterly. All vocabularies are available at no fee for research purposes within an institution, but UMLS users are required to sign a license agreement. The UMLS knowledge sources are distributed on CD‐ROM and by FTP.}
      \field{day}{1}
      \field{issn}{0305-1048}
      \field{issue}{suppl\_1}
      \field{journaltitle}{Nucleic Acids Research}
      \field{month}{1}
      \field{shortjournal}{Nucleic Acids Research}
      \field{shorttitle}{The {{Unified Medical Language System}} ({{UMLS}})}
      \field{title}{The {{Unified Medical Language System}} ({{UMLS}}): Integrating Biomedical Terminology}
      \field{urlday}{1}
      \field{urlmonth}{10}
      \field{urlyear}{2021}
      \field{volume}{32}
      \field{year}{2004}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \field{pages}{D267\bibrangedash D270}
      \range{pages}{-1}
      \verb{doi}
      \verb 10.1093/nar/gkh061
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/YWB3UPRY/Bodenreider - 2004 - The Unified Medical Language System (UMLS) integr.pdf;/Users/landes/opt/var/zotero/storage/ADXLIRR8/2505235.html
      \endverb
      \verb{urlraw}
      \verb https://doi.org/10.1093/nar/gkh061
      \endverb
      \verb{url}
      \verb https://doi.org/10.1093/nar/gkh061
      \endverb
    \endentry
    \entry{beamClinicalConceptEmbeddings2020}{article}{}
      \name{author}{9}{}{%
        {{hash=3333cfe95922b8f5d8bac7127e304455}{%
           family={Beam},
           familyi={B\bibinitperiod},
           given={Andrew\bibnamedelima L.},
           giveni={A\bibinitperiod\bibinitdelim L\bibinitperiod}}}%
        {{hash=81b5825980fce2808257a1af8cf24dfd}{%
           family={Kompa},
           familyi={K\bibinitperiod},
           given={Benjamin},
           giveni={B\bibinitperiod}}}%
        {{hash=77cc1e5e1e0bc4f384d726c00f979431}{%
           family={Schmaltz},
           familyi={S\bibinitperiod},
           given={Allen},
           giveni={A\bibinitperiod}}}%
        {{hash=f4cdaa0a40cf87104b9919a709806f7b}{%
           family={Fried},
           familyi={F\bibinitperiod},
           given={Inbar},
           giveni={I\bibinitperiod}}}%
        {{hash=354528270dae01ae482e3afbb64658f5}{%
           family={Weber},
           familyi={W\bibinitperiod},
           given={Griffin},
           giveni={G\bibinitperiod}}}%
        {{hash=db8ded231ae00be5e5eed437df809c7a}{%
           family={Palmer},
           familyi={P\bibinitperiod},
           given={Nathan},
           giveni={N\bibinitperiod}}}%
        {{hash=cb40708914697ee047c3a5ff66fc005b}{%
           family={Shi},
           familyi={S\bibinitperiod},
           given={Xu},
           giveni={X\bibinitperiod}}}%
        {{hash=1df414765f32cd3fb95f7ca80bfb5b56}{%
           family={Cai},
           familyi={C\bibinitperiod},
           given={Tianxi},
           giveni={T\bibinitperiod}}}%
        {{hash=7d569ca862abfbea5bb908a4fd1990f5}{%
           family={Kohane},
           familyi={K\bibinitperiod},
           given={Isaac\bibnamedelima S.},
           giveni={I\bibinitperiod\bibinitdelim S\bibinitperiod}}}%
      }
      \strng{namehash}{f9bd91dcf126e3dfb6e341a83860a1c7}
      \strng{fullhash}{8275fc48484c8d8a3003ef3632f66611}
      \strng{bibnamehash}{f9bd91dcf126e3dfb6e341a83860a1c7}
      \strng{authorbibnamehash}{f9bd91dcf126e3dfb6e341a83860a1c7}
      \strng{authornamehash}{f9bd91dcf126e3dfb6e341a83860a1c7}
      \strng{authorfullhash}{8275fc48484c8d8a3003ef3632f66611}
      \field{sortinit}{8}
      \field{sortinithash}{a231b008ebf0ecbe0b4d96dcc159445f}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{abstract}{Word embeddings are a popular approach to unsupervised learning of word relationships that are widely used in natural language processing. In this article, we present a new set of embeddings for medical concepts learned using an extremely large collection of multimodal medical data. Leaning on recent theoretical insights, we demonstrate how an insurance claims database of 60 million members, a collection of 20 million clinical notes, and 1.7 million full text biomedical journal articles can be combined to embed concepts into a common space, resulting in the largest ever set of embeddings for 108,477 medical concepts. To evaluate our approach, we present a new benchmark methodology based on statistical power specifically designed to test embeddings of medical concepts. Our approach, called cui2vec, attains state-of-the-art performance relative to previous methods in most instances. Finally, we provide a downloadable set of pre-trained embeddings for other researchers to use, as well as an online tool for interactive exploration of the cui2vec embeddings.}
      \field{eprinttype}{pubmed}
      \field{issn}{2335-6936}
      \field{journaltitle}{Pacific Symposium on Biocomputing. Pacific Symposium on Biocomputing}
      \field{langid}{english}
      \field{shortjournal}{Pac Symp Biocomput}
      \field{title}{Clinical {{Concept Embeddings Learned}} from {{Massive Sources}} of {{Multimodal Medical Data}}}
      \field{volume}{25}
      \field{year}{2020}
      \field{dateera}{ce}
      \field{pages}{295\bibrangedash 306}
      \range{pages}{12}
      \verb{doi}
      \verb 10.1142/9789811215636_0027
      \endverb
      \verb{eprint}
      \verb 31797605
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/8MNQ476K/Beam et al. - 2019 - Clinical Concept Embeddings Learned from Massive S.pdf;/Users/landes/opt/var/zotero/storage/NQQT4BMF/vignette.html
      \endverb
      \keyw{Computer Science - Artificial Intelligence,Computer Science - Computation and Language,Statistics - Machine Learning}
    \endentry
    \entry{mikolovEfficientEstimationWord2013}{misc}{}
      \name{author}{4}{}{%
        {{hash=a2d359b12ca2fadf0b40136a73f021bb}{%
           family={Mikolov},
           familyi={M\bibinitperiod},
           given={Tomas},
           giveni={T\bibinitperiod}}}%
        {{hash=ee3f7d7b96add98106db907e189d6c13}{%
           family={Chen},
           familyi={C\bibinitperiod},
           given={Kai},
           giveni={K\bibinitperiod}}}%
        {{hash=3d11e6f2a0d0a1183b2cf62996525afc}{%
           family={Corrado},
           familyi={C\bibinitperiod},
           given={Greg},
           giveni={G\bibinitperiod}}}%
        {{hash=4aecfb0cc2e1e3b7899129fa2a94e2b8}{%
           family={Dean},
           familyi={D\bibinitperiod},
           given={Jeffrey},
           giveni={J\bibinitperiod}}}%
      }
      \strng{namehash}{d4849f6d57e38d9b9846cfb360e45131}
      \strng{fullhash}{f24c60896b6daa69474b40efb61f4e88}
      \strng{bibnamehash}{f24c60896b6daa69474b40efb61f4e88}
      \strng{authorbibnamehash}{f24c60896b6daa69474b40efb61f4e88}
      \strng{authornamehash}{d4849f6d57e38d9b9846cfb360e45131}
      \strng{authorfullhash}{f24c60896b6daa69474b40efb61f4e88}
      \field{extraname}{1}
      \field{sortinit}{8}
      \field{sortinithash}{a231b008ebf0ecbe0b4d96dcc159445f}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{eprinttype}{arXiv}
      \field{howpublished}{arXiv: 1301.3781 (Only available as arXiv preprint)}
      \field{pubstate}{prepublished}
      \field{title}{Efficient Estimation of Word Representations in Vector Space}
      \field{year}{2013}
      \field{dateera}{ce}
      \verb{eprint}
      \verb 1301.3781
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/9ADZ2JFK/Mikolov et al. - 2013 - Efficient estimation of word representations in ve.pdf
      \endverb
    \endentry
    \entry{mikolovDistributedRepresentationsWords2013}{inproceedings}{}
      \name{author}{5}{}{%
        {{hash=a2d359b12ca2fadf0b40136a73f021bb}{%
           family={Mikolov},
           familyi={M\bibinitperiod},
           given={Tomas},
           giveni={T\bibinitperiod}}}%
        {{hash=8d569d1d5b8b5a7836017a98b430f959}{%
           family={Sutskever},
           familyi={S\bibinitperiod},
           given={Ilya},
           giveni={I\bibinitperiod}}}%
        {{hash=ee3f7d7b96add98106db907e189d6c13}{%
           family={Chen},
           familyi={C\bibinitperiod},
           given={Kai},
           giveni={K\bibinitperiod}}}%
        {{hash=84d9f354fa0b45dae996f27dad2c6607}{%
           family={Corrado},
           familyi={C\bibinitperiod},
           given={Greg\bibnamedelima S},
           giveni={G\bibinitperiod\bibinitdelim S\bibinitperiod}}}%
        {{hash=62f954323339abeba6c6a240e9d2855b}{%
           family={Dean},
           familyi={D\bibinitperiod},
           given={Jeff},
           giveni={J\bibinitperiod}}}%
      }
      \list{publisher}{1}{%
        {Curran Associates, Inc.}%
      }
      \strng{namehash}{d4849f6d57e38d9b9846cfb360e45131}
      \strng{fullhash}{fde8281f0504852db8650bb0736061b6}
      \strng{bibnamehash}{fde8281f0504852db8650bb0736061b6}
      \strng{authorbibnamehash}{fde8281f0504852db8650bb0736061b6}
      \strng{authornamehash}{d4849f6d57e38d9b9846cfb360e45131}
      \strng{authorfullhash}{fde8281f0504852db8650bb0736061b6}
      \field{extraname}{2}
      \field{sortinit}{8}
      \field{sortinithash}{a231b008ebf0ecbe0b4d96dcc159445f}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{abstract}{The recently introduced continuous Skip-gram model is an efficient method for learning high-quality distributed vector representations that capture a large number of precise syntactic and semantic word relationships. In this paper we present several improvements that make the Skip-gram model more expressive and enable it to learn higher quality vectors more rapidly. We show that by subsampling frequent words we obtain significant speedup, and also learn higher quality representations as measured by our tasks. We also introduce Negative Sampling, a simplified variant of Noise Contrastive Estimation (NCE) that learns more accurate vectors for frequent words compared to the hierarchical softmax. An inherent limitation of word representations is their indifference to word order and their inability to represent idiomatic phrases. For example, the meanings of Canada'' and "Air'' cannot be easily combined to obtain "Air Canada''. Motivated by this example, we present a simple and efficient method for finding phrases, and show that their vector representations can be accurately learned by the Skip-gram model. "}
      \field{booktitle}{Advances in {{Neural Information Processing Systems}}}
      \field{title}{Distributed {{Representations}} of {{Words}} and {{Phrases}} and Their {{Compositionality}}}
      \field{urlday}{9}
      \field{urlmonth}{9}
      \field{urlyear}{2022}
      \field{volume}{26}
      \field{year}{2013}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/9JZCE88A/Mikolov et al. - 2013 - Distributed Representations of Words and Phrases a.pdf
      \endverb
      \verb{urlraw}
      \verb https://proceedings.neurips.cc/paper/2013/hash/9aa42b31882ec039965f3c4923ce901b-Abstract.html
      \endverb
      \verb{url}
      \verb https://proceedings.neurips.cc/paper/2013/hash/9aa42b31882ec039965f3c4923ce901b-Abstract.html
      \endverb
    \endentry
    \entry{kraljevicMultidomainClinicalNatural2021}{article}{}
      \name{author}{18}{}{%
        {{hash=50d14fe5e2d8aff6725c7b323744e214}{%
           family={Kraljevic},
           familyi={K\bibinitperiod},
           given={Zeljko},
           giveni={Z\bibinitperiod}}}%
        {{hash=c52f95d586b81fc9893ec0375db2721a}{%
           family={Searle},
           familyi={S\bibinitperiod},
           given={Thomas},
           giveni={T\bibinitperiod}}}%
        {{hash=febb6d83483a0a33315f559966522f09}{%
           family={Shek},
           familyi={S\bibinitperiod},
           given={Anthony},
           giveni={A\bibinitperiod}}}%
        {{hash=0f0b7baa52339ec5550da275bb3e7a60}{%
           family={Roguski},
           familyi={R\bibinitperiod},
           given={Lukasz},
           giveni={L\bibinitperiod}}}%
        {{hash=8236053c2bed25a53a21c286baaa5317}{%
           family={Noor},
           familyi={N\bibinitperiod},
           given={Kawsar},
           giveni={K\bibinitperiod}}}%
        {{hash=dec96ae79dea2bd3795abbecb07c7f22}{%
           family={Bean},
           familyi={B\bibinitperiod},
           given={Daniel},
           giveni={D\bibinitperiod}}}%
        {{hash=e3ccfffd926b7fa947732510b6aebc21}{%
           family={Mascio},
           familyi={M\bibinitperiod},
           given={Aurelie},
           giveni={A\bibinitperiod}}}%
        {{hash=93faf54b57db12f4644678edf05999c1}{%
           family={Zhu},
           familyi={Z\bibinitperiod},
           given={Leilei},
           giveni={L\bibinitperiod}}}%
        {{hash=64c707e0c9a58d189829d3409e96501c}{%
           family={Folarin},
           familyi={F\bibinitperiod},
           given={Amos\bibnamedelima A.},
           giveni={A\bibinitperiod\bibinitdelim A\bibinitperiod}}}%
        {{hash=ea2aaa2f39bc5680e5befb501d02bb96}{%
           family={Roberts},
           familyi={R\bibinitperiod},
           given={Angus},
           giveni={A\bibinitperiod}}}%
        {{hash=759be7b90dcd7f87150525c8a2eac42b}{%
           family={Bendayan},
           familyi={B\bibinitperiod},
           given={Rebecca},
           giveni={R\bibinitperiod}}}%
        {{hash=60cfdb629dcdf0a025356afdfe931450}{%
           family={Richardson},
           familyi={R\bibinitperiod},
           given={Mark\bibnamedelima P.},
           giveni={M\bibinitperiod\bibinitdelim P\bibinitperiod}}}%
        {{hash=1af97348528887ff8aef36bd7e760639}{%
           family={Stewart},
           familyi={S\bibinitperiod},
           given={Robert},
           giveni={R\bibinitperiod}}}%
        {{hash=04430dd2c14f88763b98101422a93d06}{%
           family={Shah},
           familyi={S\bibinitperiod},
           given={Anoop\bibnamedelima D.},
           giveni={A\bibinitperiod\bibinitdelim D\bibinitperiod}}}%
        {{hash=16acc25e340f704376658da01a13abd1}{%
           family={Wong},
           familyi={W\bibinitperiod},
           given={Wai\bibnamedelima Keong},
           giveni={W\bibinitperiod\bibinitdelim K\bibinitperiod}}}%
        {{hash=1db6910c9819732a35a8a7c96540f6c9}{%
           family={Ibrahim},
           familyi={I\bibinitperiod},
           given={Zina},
           giveni={Z\bibinitperiod}}}%
        {{hash=e113b8a0cc372eceb0fd1508b71d7104}{%
           family={Teo},
           familyi={T\bibinitperiod},
           given={James\bibnamedelima T.},
           giveni={J\bibinitperiod\bibinitdelim T\bibinitperiod}}}%
        {{hash=d4d7ea13413b417a5669a0e3d6d2d38d}{%
           family={Dobson},
           familyi={D\bibinitperiod},
           given={Richard\bibnamedelimb J.\bibnamedelimi B.},
           giveni={R\bibinitperiod\bibinitdelim J\bibinitperiod\bibinitdelim B\bibinitperiod}}}%
      }
      \strng{namehash}{94c9e7b79dc3480f9e1407b66263bb71}
      \strng{fullhash}{b2a38faaba5a59e3330b5c9371d37330}
      \strng{bibnamehash}{94c9e7b79dc3480f9e1407b66263bb71}
      \strng{authorbibnamehash}{94c9e7b79dc3480f9e1407b66263bb71}
      \strng{authornamehash}{94c9e7b79dc3480f9e1407b66263bb71}
      \strng{authorfullhash}{b2a38faaba5a59e3330b5c9371d37330}
      \field{sortinit}{8}
      \field{sortinithash}{a231b008ebf0ecbe0b4d96dcc159445f}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{shorttitle}
      \field{abstract}{Electronic health records (EHR) contain large volumes of unstructured text, requiring the application of information extraction (IE) technologies to enable clinical analysis. We present the open source Medical Concept Annotation Toolkit (MedCAT) that provides: (a) a novel self-supervised machine learning algorithm for extracting concepts using any concept vocabulary including UMLS/SNOMED-CT; (b) a feature-rich annotation interface for customizing and training IE models; and (c) integrations to the broader CogStack ecosystem for vendor-agnostic health system deployment. We show improved performance in extracting UMLS concepts from open datasets (F1:0.448–0.738 vs 0.429–0.650). Further real-world validation demonstrates SNOMED-CT extraction at 3 large London hospitals with self-supervised training over ∼8.8B words from ∼17M clinical records and further fine-tuning with ∼6K clinician annotated examples. We show strong transferability (F1\,{$>$}\,0.94) between hospitals, datasets and concept types indicating cross-domain EHR-agnostic utility for accelerated clinical and research use cases.}
      \field{day}{1}
      \field{issn}{0933-3657}
      \field{journaltitle}{Artificial Intelligence in Medicine}
      \field{langid}{english}
      \field{month}{7}
      \field{shortjournal}{Artificial Intelligence in Medicine}
      \field{shorttitle}{Multi-Domain Clinical Natural Language Processing with {{MedCAT}}}
      \field{title}{Multi-Domain Clinical Natural Language Processing with {{MedCAT}}: {{The Medical Concept Annotation Toolkit}}}
      \field{urlday}{9}
      \field{urlmonth}{8}
      \field{urlyear}{2021}
      \field{volume}{117}
      \field{year}{2021}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \field{pages}{102083}
      \range{pages}{1}
      \verb{doi}
      \verb 10.1016/j.artmed.2021.102083
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/F8ZPZ8V2/Kraljevic et al. - 2021 - Multi-domain clinical natural language processing .pdf;/Users/landes/opt/var/zotero/storage/JTAF32HL/S0933365721000762.html
      \endverb
      \verb{urlraw}
      \verb https://www.sciencedirect.com/science/article/pii/S0933365721000762
      \endverb
      \verb{url}
      \verb https://www.sciencedirect.com/science/article/pii/S0933365721000762
      \endverb
      \keyw{Clinical concept embeddings,Clinical natural language processing,Clinical ontology embeddings,Electronic health record information extraction}
    \endentry
    \entry{reimersSentenceBERTSentenceEmbeddings2019}{inproceedings}{}
      \name{author}{2}{}{%
        {{hash=da9947b27b0d1c4c912e2b391426d443}{%
           family={Reimers},
           familyi={R\bibinitperiod},
           given={Nils},
           giveni={N\bibinitperiod}}}%
        {{hash=ea70b44be1920f6e8c379706bc7d047a}{%
           family={Gurevych},
           familyi={G\bibinitperiod},
           given={Iryna},
           giveni={I\bibinitperiod}}}%
      }
      \list{location}{1}{%
        {Hong Kong, China}%
      }
      \list{publisher}{1}{%
        {Association for Computational Linguistics}%
      }
      \strng{namehash}{2466af6376c9c5e3658dcc6692351f3e}
      \strng{fullhash}{2466af6376c9c5e3658dcc6692351f3e}
      \strng{bibnamehash}{2466af6376c9c5e3658dcc6692351f3e}
      \strng{authorbibnamehash}{2466af6376c9c5e3658dcc6692351f3e}
      \strng{authornamehash}{2466af6376c9c5e3658dcc6692351f3e}
      \strng{authorfullhash}{2466af6376c9c5e3658dcc6692351f3e}
      \field{sortinit}{8}
      \field{sortinithash}{a231b008ebf0ecbe0b4d96dcc159445f}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{shorttitle}
      \field{abstract}{BERT (Devlin et al., 2018) and RoBERTa (Liu et al., 2019) has set a new state-of-the-art performance on sentence-pair regression tasks like semantic textual similarity (STS). However, it requires that both sentences are fed into the network, which causes a massive computational overhead: Finding the most similar pair in a collection of 10,000 sentences requires about 50 million inference computations (\textbackslash textasciitilde65 hours) with BERT. The construction of BERT makes it unsuitable for semantic similarity search as well as for unsupervised tasks like clustering. In this publication, we present Sentence-BERT (SBERT), a modification of the pretrained BERT network that use siamese and triplet network structures to derive semantically meaningful sentence embeddings that can be compared using cosine-similarity. This reduces the effort for finding the most similar pair from 65 hours with BERT / RoBERTa to about 5 seconds with SBERT, while maintaining the accuracy from BERT. We evaluate SBERT and SRoBERTa on common STS tasks and transfer learning tasks, where it outperforms other state-of-the-art sentence embeddings methods.}
      \field{booktitle}{Proceedings of the 2019 {{Conference}} on {{Empirical Methods}} in {{Natural Language Processing}} and the 9th {{International Joint Conference}} on {{Natural Language Processing}} ({{EMNLP-IJCNLP}})}
      \field{eventtitle}{{{EMNLP-IJCNLP}} 2019}
      \field{month}{11}
      \field{shorttitle}{Sentence-{{BERT}}}
      \field{title}{Sentence-{{BERT}}: {{Sentence Embeddings}} Using {{Siamese BERT-Networks}}}
      \field{urlday}{9}
      \field{urlmonth}{11}
      \field{urlyear}{2021}
      \field{year}{2019}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \field{pages}{3982\bibrangedash 3992}
      \range{pages}{11}
      \verb{doi}
      \verb 10.18653/v1/D19-1410
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/2EMJMDC4/Reimers and Gurevych - 2019 - Sentence-BERT Sentence Embeddings using Siamese B.pdf
      \endverb
      \verb{urlraw}
      \verb https://aclanthology.org/D19-1410
      \endverb
      \verb{url}
      \verb https://aclanthology.org/D19-1410
      \endverb
    \endentry
    \entry{dekaImprovedMethodsAid2022}{article}{}
      \name{author}{3}{}{%
        {{hash=700c0c772caf7567b6c99c15ea27b85b}{%
           family={Deka},
           familyi={D\bibinitperiod},
           given={Pritam},
           giveni={P\bibinitperiod}}}%
        {{hash=e424a1b431d3770d94f5253b611db06a}{%
           family={Jurek-Loughrey},
           familyi={J\bibinithyphendelim L\bibinitperiod},
           given={Anna},
           giveni={A\bibinitperiod}}}%
        {{hash=1836ce1e72a133641077f8df764789c8}{%
           family={Padmanabhan},
           familyi={P\bibinitperiod},
           given={Deepak},
           giveni={D\bibinitperiod}}}%
      }
      \strng{namehash}{5b0c0899bb2e6af3c01a471a32bec017}
      \strng{fullhash}{0711c3b4cd6592540a01bd647d8f5156}
      \strng{bibnamehash}{0711c3b4cd6592540a01bd647d8f5156}
      \strng{authorbibnamehash}{0711c3b4cd6592540a01bd647d8f5156}
      \strng{authornamehash}{5b0c0899bb2e6af3c01a471a32bec017}
      \strng{authorfullhash}{0711c3b4cd6592540a01bd647d8f5156}
      \field{sortinit}{8}
      \field{sortinithash}{a231b008ebf0ecbe0b4d96dcc159445f}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{abstract}{False information in the domain of online health related articles is of great concern,which has been witnessed abundantly in the current pandemic situation of Covid-19.Recent advancements in the field of Machine Learning and Natural Language Processingcan be leveraged to aid people in distinguishing false information from the truth in thedomain of online health articles. Whilst there has been substantial progress in this spaceover the years, research in this area has mainly focused on the sphere of political news.Health fake news is markedly different from fake news in the political context as healthinformation should be evaluated against the most recent and reliable medical resourcessuch as scholarly repositories. However, one of the challenges with such an approachis the retrieval of the pertinent resources. In this work, we formulate two techniquesfor the retrieval of the most relevant authoritative and reliable medical content fromscholarly repositories which can be used to assess veracity of an online health article.The first technique is an unsupervised method of generating queries from claims whichare extracted from an online health article. We propose a three-step approach for it andillustrate that our method is able to generate effective queries which can be used forretrieval of information from medical knowledge databases. The second method involvesa filtering approach for extracting the most relevant information for the claims. Weshow how this can be achieved with the help of state of the art transformer models andillustrate it’s effectiveness over other methods.}
      \field{journaltitle}{Journal of Data Intelligence}
      \field{month}{11}
      \field{number}{4}
      \field{title}{Improved Methods to Aid Unsupervised Evidence-Based Fact Checking for Online Health News}
      \field{urlday}{8}
      \field{urlmonth}{10}
      \field{urlyear}{2024}
      \field{volume}{3}
      \field{year}{2022}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \field{pages}{474\bibrangedash 505}
      \range{pages}{32}
      \verb{doi}
      \verb 10.26421/JDI3.4-5
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/UANCE963/Deka et al. - 2022 - Improved methods to aid unsupervised evidence-based fact checking for online health news.pdf
      \endverb
      \verb{urlraw}
      \verb https://www.rintonpress.com/journals/jdionline.html
      \endverb
      \verb{url}
      \verb https://www.rintonpress.com/journals/jdionline.html
      \endverb
    \endentry
    \entry{wuGoogleNeuralMachine2016}{misc}{}
      \name{author}{31}{}{%
        {{hash=1fc7a40d6072b1bb1d4e56d14ef88e2f}{%
           family={Wu},
           familyi={W\bibinitperiod},
           given={Yonghui},
           giveni={Y\bibinitperiod}}}%
        {{hash=29ea22df63f174ac629e9ef100b40484}{%
           family={Schuster},
           familyi={S\bibinitperiod},
           given={Mike},
           giveni={M\bibinitperiod}}}%
        {{hash=c0d10aaf985cebf8d0497e1828f9313f}{%
           family={Chen},
           familyi={C\bibinitperiod},
           given={Zhifeng},
           giveni={Z\bibinitperiod}}}%
        {{hash=c636f146591d51579a8119b777394878}{%
           family={Le},
           familyi={L\bibinitperiod},
           given={Quoc\bibnamedelima V.},
           giveni={Q\bibinitperiod\bibinitdelim V\bibinitperiod}}}%
        {{hash=e34c5aa67281924804d54d88e58ca38a}{%
           family={Norouzi},
           familyi={N\bibinitperiod},
           given={Mohammad},
           giveni={M\bibinitperiod}}}%
        {{hash=3e02b95f1e35ef8d397835766063a915}{%
           family={Macherey},
           familyi={M\bibinitperiod},
           given={Wolfgang},
           giveni={W\bibinitperiod}}}%
        {{hash=8c2ce3e06666676855e01e5bb2466d92}{%
           family={Krikun},
           familyi={K\bibinitperiod},
           given={Maxim},
           giveni={M\bibinitperiod}}}%
        {{hash=2923de2da7f9b32b957552e414b6bc16}{%
           family={Cao},
           familyi={C\bibinitperiod},
           given={Yuan},
           giveni={Y\bibinitperiod}}}%
        {{hash=841cd6340c46b48aff116aaace5177f6}{%
           family={Gao},
           familyi={G\bibinitperiod},
           given={Qin},
           giveni={Q\bibinitperiod}}}%
        {{hash=15662c2bdf7c38938fe27c84d2f821fe}{%
           family={Macherey},
           familyi={M\bibinitperiod},
           given={Klaus},
           giveni={K\bibinitperiod}}}%
        {{hash=76d78fa8d6bcc0a03c768f284b7445b2}{%
           family={Klingner},
           familyi={K\bibinitperiod},
           given={Jeff},
           giveni={J\bibinitperiod}}}%
        {{hash=2f77a417cb674d5f294913225ae20e42}{%
           family={Shah},
           familyi={S\bibinitperiod},
           given={Apurva},
           giveni={A\bibinitperiod}}}%
        {{hash=b76c4102bf39f677ea9c0f7c2a5f236a}{%
           family={Johnson},
           familyi={J\bibinitperiod},
           given={Melvin},
           giveni={M\bibinitperiod}}}%
        {{hash=6026405c5af9112230e8ff8bf18dd043}{%
           family={Liu},
           familyi={L\bibinitperiod},
           given={Xiaobing},
           giveni={X\bibinitperiod}}}%
        {{hash=540fcd72e1fa4bbed46604f4e6cff817}{%
           family={Kaiser},
           familyi={K\bibinitperiod},
           given={Łukasz},
           giveni={Ł\bibinitperiod}}}%
        {{hash=353c4a3aa4878af27170be1cfd53bd8a}{%
           family={Gouws},
           familyi={G\bibinitperiod},
           given={Stephan},
           giveni={S\bibinitperiod}}}%
        {{hash=cc6590b280716ad064718f8d18f2a53f}{%
           family={Kato},
           familyi={K\bibinitperiod},
           given={Yoshikiyo},
           giveni={Y\bibinitperiod}}}%
        {{hash=ea1d04e9781edc1ab4ccafb0d8ff5179}{%
           family={Kudo},
           familyi={K\bibinitperiod},
           given={Taku},
           giveni={T\bibinitperiod}}}%
        {{hash=fc6dcce1f2845b14d1315cb56f430b85}{%
           family={Kazawa},
           familyi={K\bibinitperiod},
           given={Hideto},
           giveni={H\bibinitperiod}}}%
        {{hash=7970dc920ecd23f635158e89bed903aa}{%
           family={Stevens},
           familyi={S\bibinitperiod},
           given={Keith},
           giveni={K\bibinitperiod}}}%
        {{hash=d115e2de1127519c117a7252205efcdb}{%
           family={Kurian},
           familyi={K\bibinitperiod},
           given={George},
           giveni={G\bibinitperiod}}}%
        {{hash=98e48fd2ef83c15cb4e696e6243eef05}{%
           family={Patil},
           familyi={P\bibinitperiod},
           given={Nishant},
           giveni={N\bibinitperiod}}}%
        {{hash=f27ec46ccd272a021fd78bdac92dd490}{%
           family={Wang},
           familyi={W\bibinitperiod},
           given={Wei},
           giveni={W\bibinitperiod}}}%
        {{hash=2b3412c48bab46f41faab78455fce0e1}{%
           family={Young},
           familyi={Y\bibinitperiod},
           given={Cliff},
           giveni={C\bibinitperiod}}}%
        {{hash=dd794e3fc42625216f13506936f9efea}{%
           family={Smith},
           familyi={S\bibinitperiod},
           given={Jason},
           giveni={J\bibinitperiod}}}%
        {{hash=b137e608b42835dfb224061b97b8aba4}{%
           family={Riesa},
           familyi={R\bibinitperiod},
           given={Jason},
           giveni={J\bibinitperiod}}}%
        {{hash=fbb9f043628eafbecb00f2bfc6ae71bf}{%
           family={Rudnick},
           familyi={R\bibinitperiod},
           given={Alex},
           giveni={A\bibinitperiod}}}%
        {{hash=494b568c5dc85ba8f3f409635f9c5f25}{%
           family={Vinyals},
           familyi={V\bibinitperiod},
           given={Oriol},
           giveni={O\bibinitperiod}}}%
        {{hash=3d11e6f2a0d0a1183b2cf62996525afc}{%
           family={Corrado},
           familyi={C\bibinitperiod},
           given={Greg},
           giveni={G\bibinitperiod}}}%
        {{hash=cc840f3c806989f01823d8e1ef19c2e7}{%
           family={Hughes},
           familyi={H\bibinitperiod},
           given={Macduff},
           giveni={M\bibinitperiod}}}%
        {{hash=4aecfb0cc2e1e3b7899129fa2a94e2b8}{%
           family={Dean},
           familyi={D\bibinitperiod},
           given={Jeffrey},
           giveni={J\bibinitperiod}}}%
      }
      \strng{namehash}{5e7ea1b72e68507bb740c6a9bec1477a}
      \strng{fullhash}{60578079489d2f4fd3110ab834fa69f3}
      \strng{bibnamehash}{5e7ea1b72e68507bb740c6a9bec1477a}
      \strng{authorbibnamehash}{5e7ea1b72e68507bb740c6a9bec1477a}
      \strng{authornamehash}{5e7ea1b72e68507bb740c6a9bec1477a}
      \strng{authorfullhash}{60578079489d2f4fd3110ab834fa69f3}
      \field{sortinit}{8}
      \field{sortinithash}{a231b008ebf0ecbe0b4d96dcc159445f}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{shorttitle}
      \field{abstract}{Neural Machine Translation (NMT) is an end-to-end learning approach for automated translation, with the potential to overcome many of the weaknesses of conventional phrase-based translation systems. Unfortunately, NMT systems are known to be computationally expensive both in training and in translation inference. Also, most NMT systems have difficulty with rare words. These issues have hindered NMT's use in practical deployments and services, where both accuracy and speed are essential. In this work, we present GNMT, Google's Neural Machine Translation system, which attempts to address many of these issues. Our model consists of a deep LSTM network with 8 encoder and 8 decoder layers using attention and residual connections. To improve parallelism and therefore decrease training time, our attention mechanism connects the bottom layer of the decoder to the top layer of the encoder. To accelerate the final translation speed, we employ low-precision arithmetic during inference computations. To improve handling of rare words, we divide words into a limited set of common sub-word units ("wordpieces") for both input and output. This method provides a good balance between the flexibility of "character"-delimited models and the efficiency of "word"-delimited models, naturally handles translation of rare words, and ultimately improves the overall accuracy of the system. Our beam search technique employs a length-normalization procedure and uses a coverage penalty, which encourages generation of an output sentence that is most likely to cover all the words in the source sentence. On the WMT'14 English-to-French and English-to-German benchmarks, GNMT achieves competitive results to state-of-the-art. Using a human side-by-side evaluation on a set of isolated simple sentences, it reduces translation errors by an average of 60\% compared to Google's phrase-based production system.}
      \field{day}{8}
      \field{eprintclass}{cs}
      \field{eprinttype}{arXiv}
      \field{howpublished}{arXiv: 1609.08144 (Only available as arXiv preprint)}
      \field{month}{10}
      \field{shorttitle}{Google's {{Neural Machine Translation System}}}
      \field{title}{Google's {{Neural Machine Translation System}}: {{Bridging}} the {{Gap}} between {{Human}} and {{Machine Translation}}}
      \field{urlday}{24}
      \field{urlmonth}{6}
      \field{urlyear}{2021}
      \field{year}{2016}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \verb{eprint}
      \verb 1609.08144
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/2R6WZHV2/Wu et al. - 2016 - Google's Neural Machine Translation System Bridgi.pdf;/Users/landes/opt/var/zotero/storage/SCSYVHV2/1609.html
      \endverb
      \verb{urlraw}
      \verb http://arxiv.org/abs/1609.08144
      \endverb
      \verb{url}
      \verb http://arxiv.org/abs/1609.08144
      \endverb
      \keyw{Computer Science - Artificial Intelligence,Computer Science - Computation and Language,Computer Science - Machine Learning}
    \endentry
  \enddatalist
\endrefsection
\endinput


% $ biblatex auxiliary file $
% $ biblatex bbl format version 3.2 $
% Do not modify the above lines!
%
% This is an auxiliary file used by the 'biblatex' package.
% This file may safely be deleted. It will be recreated by
% biber as required.
%
\begingroup
\makeatletter
\@ifundefined{ver@biblatex.sty}
  {\@latex@error
     {Missing 'biblatex' package}
     {The bibliography requires the 'biblatex' package.}
      \aftergroup\endinput}
  {}
\endgroup


\refsection{0}
  \datalist[entry]{none/global//global/global}
    \entry{hill-briggsSocialDeterminantsHealth2021}{article}{}
      \name{author}{8}{}{%
        {{hash=26c0545418813c15dfddd1a0cd87a428}{%
           family={Hill-Briggs},
           familyi={H\bibinithyphendelim B\bibinitperiod},
           given={Felicia},
           giveni={F\bibinitperiod}}}%
        {{hash=86ca2ab3b6319d81e15ddb1665faf65b}{%
           family={Adler},
           familyi={A\bibinitperiod},
           given={Nancy\bibnamedelima E.},
           giveni={N\bibinitperiod\bibinitdelim E\bibinitperiod}}}%
        {{hash=5210545ab364007a031f272d8a5e182f}{%
           family={Berkowitz},
           familyi={B\bibinitperiod},
           given={Seth\bibnamedelima A.},
           giveni={S\bibinitperiod\bibinitdelim A\bibinitperiod}}}%
        {{hash=a178cf5382ca632c773f114c7dde3f47}{%
           family={Chin},
           familyi={C\bibinitperiod},
           given={Marshall\bibnamedelima H.},
           giveni={M\bibinitperiod\bibinitdelim H\bibinitperiod}}}%
        {{hash=8e4b36e1bf6ce89a88d52812d32c2202}{%
           family={Gary-Webb},
           familyi={G\bibinithyphendelim W\bibinitperiod},
           given={Tiffany\bibnamedelima L.},
           giveni={T\bibinitperiod\bibinitdelim L\bibinitperiod}}}%
        {{hash=39876a0ae590b9456795bdc72410641f}{%
           family={Navas-Acien},
           familyi={N\bibinithyphendelim A\bibinitperiod},
           given={Ana},
           giveni={A\bibinitperiod}}}%
        {{hash=0fab945636e388bf3d6266edfeb6b831}{%
           family={Thornton},
           familyi={T\bibinitperiod},
           given={Pamela\bibnamedelima L.},
           giveni={P\bibinitperiod\bibinitdelim L\bibinitperiod}}}%
        {{hash=7485244f3c5e3894329afb1ab4265b78}{%
           family={Haire-Joshu},
           familyi={H\bibinithyphendelim J\bibinitperiod},
           given={Debra},
           giveni={D\bibinitperiod}}}%
      }
      \strng{namehash}{3c6be19d1c7ff49a4e52f6e0704bdbb9}
      \strng{fullhash}{21560e9a598cfd228711f1ccca4b6f09}
      \strng{bibnamehash}{3c6be19d1c7ff49a4e52f6e0704bdbb9}
      \strng{authorbibnamehash}{3c6be19d1c7ff49a4e52f6e0704bdbb9}
      \strng{authornamehash}{3c6be19d1c7ff49a4e52f6e0704bdbb9}
      \strng{authorfullhash}{21560e9a598cfd228711f1ccca4b6f09}
      \field{sortinit}{1}
      \field{sortinithash}{4f6aaa89bab872aa0999fec09ff8e98a}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{shorttitle}
      \field{eprinttype}{pubmed}
      \field{issn}{0149-5992}
      \field{journaltitle}{Diabetes Care}
      \field{month}{1}
      \field{number}{1}
      \field{shortjournal}{Diabetes Care}
      \field{shorttitle}{Social {{Determinants}} of {{Health}} and {{Diabetes}}}
      \field{title}{Social {{Determinants}} of {{Health}} and {{Diabetes}}: {{A Scientific Review}}}
      \field{urlday}{4}
      \field{urlmonth}{10}
      \field{urlyear}{2024}
      \field{volume}{44}
      \field{year}{2021}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \field{pages}{258\bibrangedash 279}
      \range{pages}{22}
      \verb{doi}
      \verb 10.2337/dci20-0053
      \endverb
      \verb{eprint}
      \verb 33139407
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/III5XV86/Hill-Briggs et al. - 2021 - Social Determinants of Health and Diabetes A Scientific Review.pdf
      \endverb
      \verb{urlraw}
      \verb https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7783927/
      \endverb
      \verb{url}
      \verb https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7783927/
      \endverb
    \endentry
    \entry{lyerlaRecurrentDKAResults2021}{article}{}
      \name{author}{6}{}{%
        {{hash=09b5163c3f250b97be553045dca446c1}{%
           family={Lyerla},
           familyi={L\bibinitperiod},
           given={Ryan},
           giveni={R\bibinitperiod}}}%
        {{hash=deeed9fb1aae26e353b452abab100bd3}{%
           family={Johnson-Rabbett},
           familyi={J\bibinithyphendelim R\bibinitperiod},
           given={Brianna},
           giveni={B\bibinitperiod}}}%
        {{hash=bfb2dbc6a1b5717346cdf88f31a9cc46}{%
           family={Shakally},
           familyi={S\bibinitperiod},
           given={Almoutaz},
           giveni={A\bibinitperiod}}}%
        {{hash=6239f36e7db6833e445df2c0c1bdbfc7}{%
           family={Magar},
           familyi={M\bibinitperiod},
           given={Rekha},
           giveni={R\bibinitperiod}}}%
        {{hash=767c91bf80b6ba3510bbe3116962d223}{%
           family={Alameddine},
           familyi={A\bibinitperiod},
           given={Hind},
           giveni={H\bibinitperiod}}}%
        {{hash=8131a0e6e102ef8d80d6489e1c0ba68c}{%
           family={Fish},
           familyi={F\bibinitperiod},
           given={Lisa},
           giveni={L\bibinitperiod}}}%
      }
      \strng{namehash}{e036531c06938902094bb3216c8c051b}
      \strng{fullhash}{1d23fc23cc1ffa4bb37e3f1e546c9d9a}
      \strng{bibnamehash}{e036531c06938902094bb3216c8c051b}
      \strng{authorbibnamehash}{e036531c06938902094bb3216c8c051b}
      \strng{authornamehash}{e036531c06938902094bb3216c8c051b}
      \strng{authorfullhash}{1d23fc23cc1ffa4bb37e3f1e546c9d9a}
      \field{sortinit}{2}
      \field{sortinithash}{8b555b3791beccb63322c22f3320aa9a}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{abstract}{AIMS: Diabetic ketoacidosis (DKA) is an emergency with high morbidity and mortality. This study examined patient factors associated with hospitalization for recurrent DKA. METHODS: Characteristics of 265 subjects admitted for DKA at Hennepin County Medical Center between January 2017 and January 2019 were retrospectively analyzed. Differences between subjects with a single admission versus multiple were reviewed. RESULTS: Forty-eight out of 265 patients had recurrent DKA. Risk factors included African American race (adjusted odds ratio (aOR) versus white non-Hispanic\,=\,4.6, 95\% CI 1.8-13, p\,=\,0.001) or other race/ethnicity (aOR\,=\,8.6, 2.9-28, p\,{$<$}\,0.0001), younger age (aOR 37-52y versus 18-36y\,=\,0.48, 0.19-1.16, p\,=\,0.10; aOR 53-99y versus 18-36y\,=\,0.37, 0.12-0.99, p\,=\,0.05), type 1 diabetes mellitus (aOR\,=\,2.4, 1.1-5.5, p\,=\,0.04), ever homeless (aOR\,=\,2.5, 1.1-5.4, p\,=\,0.03), and drug abuse (aOR\,=\,3.2, 1.3-7.8, p\,=\,0.009). DKA cost a median of \$29,981 per admission. CONCLUSIONS: Recurrent DKA is costly, and social determinants are strong predictors of recurrence. This study highlights the need for targeted preventative care programs.}
      \field{day}{1}
      \field{eprinttype}{pubmed}
      \field{issn}{2055-8260}
      \field{journaltitle}{Clinical Diabetes and Endocrinology}
      \field{langid}{english}
      \field{month}{8}
      \field{number}{1}
      \field{shortjournal}{Clin Diabetes Endocrinol}
      \field{title}{Recurrent {{DKA}} Results in High Societal Costs - a Retrospective Study Identifying Social Predictors of Recurrence for Potential Future Intervention}
      \field{volume}{7}
      \field{year}{2021}
      \field{dateera}{ce}
      \field{pages}{13}
      \range{pages}{1}
      \verb{doi}
      \verb 10.1186/s40842-021-00127-6
      \endverb
      \verb{eprint}
      \verb 34332631
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/YFRSMVJM/Lyerla et al. - 2021 - Recurrent DKA results in high societal costs - a retrospective study identifying social predictors o.pdf
      \endverb
      \keyw{Barriers to care,Insulin cost,Recurrent DKA}
    \endentry
    \entry{keenanSocialFactorsAssociated2002}{article}{}
      \name{author}{3}{}{%
        {{hash=57dc5bf6d5c766421e26177484c45a7f}{%
           family={Keenan},
           familyi={K\bibinitperiod},
           given={Heather},
           giveni={H\bibinitperiod}}}%
        {{hash=d722401ad1d8e477d6613d9610f7a90a}{%
           family={Foster},
           familyi={F\bibinitperiod},
           given={Carol},
           giveni={C\bibinitperiod}}}%
        {{hash=a505751887c37d5ed71c04ff6f4a3e09}{%
           family={Bratton},
           familyi={B\bibinitperiod},
           given={Susan},
           giveni={S\bibinitperiod}}}%
      }
      \list{publisher}{1}{%
        {Pediatrics}%
      }
      \strng{namehash}{37ee3468e432400b3fd4693262f3f6ba}
      \strng{fullhash}{7aaa23c672252db5a6b67a852dc5a067}
      \strng{bibnamehash}{7aaa23c672252db5a6b67a852dc5a067}
      \strng{authorbibnamehash}{7aaa23c672252db5a6b67a852dc5a067}
      \strng{authornamehash}{37ee3468e432400b3fd4693262f3f6ba}
      \strng{authorfullhash}{7aaa23c672252db5a6b67a852dc5a067}
      \field{sortinit}{3}
      \field{sortinithash}{ad6fe7482ffbd7b9f99c9e8b5dccd3d7}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{abstract}{When compared with state census data, nonwhite and poor children were more likely to be admitted with complications of DM and to have significantly prolonged and expensive hospital stays. These children should be targeted for intensive diabetes education and outpatient medical support both to improv …}
      \field{eprinttype}{pubmed}
      \field{issn}{1098-4275}
      \field{journaltitle}{Pediatrics}
      \field{langid}{english}
      \field{month}{1}
      \field{number}{1}
      \field{title}{Social Factors Associated with Prolonged Hospitalization among Diabetic Children}
      \field{urlday}{4}
      \field{urlmonth}{10}
      \field{urlyear}{2024}
      \field{volume}{109}
      \field{year}{2002}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \verb{doi}
      \verb 10.1542/peds.109.1.40
      \endverb
      \verb{eprint}
      \verb 11773540
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/8UJM4FTQ/11773540.html
      \endverb
      \verb{urlraw}
      \verb https://pubmed.ncbi.nlm.nih.gov/11773540/
      \endverb
      \verb{url}
      \verb https://pubmed.ncbi.nlm.nih.gov/11773540/
      \endverb
    \endentry
    \entry{liRealizingPotentialSocial2024}{article}{}
      \name{author}{16}{}{%
        {{hash=38982a068d993b656747eda3c1d05082}{%
           family={Li},
           familyi={L\bibinitperiod},
           given={Chenyu},
           giveni={C\bibinitperiod}}}%
        {{hash=05f1279cb767b015c0865cf88c573227}{%
           family={Mowery},
           familyi={M\bibinitperiod},
           given={Danielle\bibnamedelima L.},
           giveni={D\bibinitperiod\bibinitdelim L\bibinitperiod}}}%
        {{hash=3724047c567c474cef1765d0a3d43b4d}{%
           family={Ma},
           familyi={M\bibinitperiod},
           given={Xiaomeng},
           giveni={X\bibinitperiod}}}%
        {{hash=c4f0c9678fb69ebf79ff4210b385eee5}{%
           family={Yang},
           familyi={Y\bibinitperiod},
           given={Rui},
           giveni={R\bibinitperiod}}}%
        {{hash=b67a48c59362c0f00a93fb2a42664f68}{%
           family={Vurgun},
           familyi={V\bibinitperiod},
           given={Ugurcan},
           giveni={U\bibinitperiod}}}%
        {{hash=5f1a06819bdffa714b9cd1acd4200881}{%
           family={Hwang},
           familyi={H\bibinitperiod},
           given={Sy},
           giveni={S\bibinitperiod}}}%
        {{hash=a43ae518e5c56fdea08a6ad2acdbd17b}{%
           family={Donnelly},
           familyi={D\bibinitperiod},
           given={Hayoung\bibnamedelima K.},
           giveni={H\bibinitperiod\bibinitdelim K\bibinitperiod}}}%
        {{hash=06d2672fcb7615b01323ed7b427e8b01}{%
           family={Bandhey},
           familyi={B\bibinitperiod},
           given={Harsh},
           giveni={H\bibinitperiod}}}%
        {{hash=7de5de10edad55acd0b3fbd7ddcd1f24}{%
           family={Senathirajah},
           familyi={S\bibinitperiod},
           given={Yalini},
           giveni={Y\bibinitperiod}}}%
        {{hash=039552d1a26da0c11fec71189a7e414c}{%
           family={Visweswaran},
           familyi={V\bibinitperiod},
           given={Shyam},
           giveni={S\bibinitperiod}}}%
        {{hash=d68ab78bd8cfa37a0872050879a414f2}{%
           family={Sadhu},
           familyi={S\bibinitperiod},
           given={Eugene\bibnamedelima M.},
           giveni={E\bibinitperiod\bibinitdelim M\bibinitperiod}}}%
        {{hash=7c0fbe2d5a7ddb67570070946d23f548}{%
           family={Akhtar},
           familyi={A\bibinitperiod},
           given={Zohaib},
           giveni={Z\bibinitperiod}}}%
        {{hash=ab919039e04cf515ca7512c1afe5b810}{%
           family={Getzen},
           familyi={G\bibinitperiod},
           given={Emily},
           giveni={E\bibinitperiod}}}%
        {{hash=7bbd76f5d74686263dc404ea083c07c9}{%
           family={Freda},
           familyi={F\bibinitperiod},
           given={Philip\bibnamedelima J.},
           giveni={P\bibinitperiod\bibinitdelim J\bibinitperiod}}}%
        {{hash=e6845a6257e44a30d9df2a428e1c68f9}{%
           family={Long},
           familyi={L\bibinitperiod},
           given={Qi},
           giveni={Q\bibinitperiod}}}%
        {{hash=83247025303f755f7e698a858ff6b421}{%
           family={Becich},
           familyi={B\bibinitperiod},
           given={Michael\bibnamedelima J.},
           giveni={M\bibinitperiod\bibinitdelim J\bibinitperiod}}}%
      }
      \strng{namehash}{3e66b3b521e3da82a91d4aeb6a59c360}
      \strng{fullhash}{7a8a477c58926b9dc09a30d9322a6d68}
      \strng{bibnamehash}{3e66b3b521e3da82a91d4aeb6a59c360}
      \strng{authorbibnamehash}{3e66b3b521e3da82a91d4aeb6a59c360}
      \strng{authornamehash}{3e66b3b521e3da82a91d4aeb6a59c360}
      \strng{authorfullhash}{7a8a477c58926b9dc09a30d9322a6d68}
      \field{sortinit}{4}
      \field{sortinithash}{9381316451d1b9788675a07e972a12a7}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{shorttitle}
      \field{abstract}{Background:Social determinants of health (SDoH), such as socioeconomics and neighborhoods, strongly influence health outcomes. However, the current state of standardized SDoH data in electronic health records (EHRs) is lacking, a significant barrier to research and care quality.Methods:We conducted a PubMed search using “SDOH” and “EHR” Medical Subject Headings terms, analyzing included articles across five domains: 1) SDoH screening and assessment approaches, 2) SDoH data collection and documentation, 3) Use of natural language processing (NLP) for extracting SDoH, 4) SDoH data and health outcomes, and 5) SDoH-driven interventions.Results:Of 685 articles identified, 324 underwent full review. Key findings include implementation of tailored screening instruments, census and claims data linkage for contextual SDoH profiles, NLP systems extracting SDoH from notes, associations between SDoH and healthcare utilization and chronic disease control, and integrated care management programs. However, variability across data sources, tools, and outcomes underscores the need for standardization.Discussion:Despite progress in identifying patient social needs, further development of standards, predictive models, and coordinated interventions is critical for SDoH-EHR integration. Additional database searches could strengthen this scoping review. Ultimately, widespread capture, analysis, and translation of multidimensional SDoH data into clinical care is essential for promoting health equity.}
      \field{issn}{2059-8661}
      \field{journaltitle}{Journal of Clinical and Translational Science}
      \field{langid}{english}
      \field{month}{1}
      \field{number}{1}
      \field{shorttitle}{Realizing the Potential of Social Determinants Data in {{EHR}} Systems}
      \field{title}{Realizing the Potential of Social Determinants Data in {{EHR}} Systems: {{A}} Scoping Review of Approaches for Screening, Linkage, Extraction, Analysis, and Interventions}
      \field{urlday}{18}
      \field{urlmonth}{3}
      \field{urlyear}{2025}
      \field{volume}{8}
      \field{year}{2024}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \field{pages}{e147}
      \range{pages}{-1}
      \verb{doi}
      \verb 10.1017/cts.2024.571
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/U7IGBREW/Li et al. - 2024 - Realizing the potential of social determinants data in EHR systems A scoping review of approaches f.pdf
      \endverb
      \verb{urlraw}
      \verb https://www.cambridge.org/core/journals/journal-of-clinical-and-translational-science/article/realizing-the-potential-of-social-determinants-data-in-ehr-systems-a-scoping-review-of-approaches-for-screening-linkage-extraction-analysis-and-interventions/158E0DF4F22EE33E2E4957E784637D26#
      \endverb
      \verb{url}
      \verb https://www.cambridge.org/core/journals/journal-of-clinical-and-translational-science/article/realizing-the-potential-of-social-determinants-data-in-ehr-systems-a-scoping-review-of-approaches-for-screening-linkage-extraction-analysis-and-interventions/158E0DF4F22EE33E2E4957E784637D26#
      \endverb
      \keyw{electronic health records,health equity,natural language processing,Social determinants of health,social risk factors}
    \endentry
    \entry{wangDocumentationReviewSocial2021}{article}{}
      \name{author}{4}{}{%
        {{hash=405aa02bca140f939bbe12e95a79804b}{%
           family={Wang},
           familyi={W\bibinitperiod},
           given={Michael},
           giveni={M\bibinitperiod}}}%
        {{hash=19cfb6097c7466dc7b027f6eceb2e9ba}{%
           family={Pantell},
           familyi={P\bibinitperiod},
           given={Matthew\bibnamedelima S},
           giveni={M\bibinitperiod\bibinitdelim S\bibinitperiod}}}%
        {{hash=0d448c3bbb5324c45bb79a87582797e3}{%
           family={Gottlieb},
           familyi={G\bibinitperiod},
           given={Laura\bibnamedelima M},
           giveni={L\bibinitperiod\bibinitdelim M\bibinitperiod}}}%
        {{hash=a2c3c364469a23f62bf47134184d2c84}{%
           family={Adler-Milstein},
           familyi={A\bibinithyphendelim M\bibinitperiod},
           given={Julia},
           giveni={J\bibinitperiod}}}%
      }
      \strng{namehash}{12ec4b257b27f7a7367538c6509303c5}
      \strng{fullhash}{ea44c194f09932aee45b0f69a3065070}
      \strng{bibnamehash}{ea44c194f09932aee45b0f69a3065070}
      \strng{authorbibnamehash}{ea44c194f09932aee45b0f69a3065070}
      \strng{authornamehash}{12ec4b257b27f7a7367538c6509303c5}
      \strng{authorfullhash}{ea44c194f09932aee45b0f69a3065070}
      \field{extraname}{1}
      \field{sortinit}{4}
      \field{sortinithash}{9381316451d1b9788675a07e972a12a7}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{shorttitle}
      \field{abstract}{Electronic Health Records (EHRs) increasingly include designated fields to capture social determinants of health (SDOH). We developed measures to characterize their use, and use of other SDOH data types, to optimize SDOH data integration.We developed 3 measures that accommodate different EHR data types on an encounter or patient-year basis. We implemented these measures—documented during encounter (DDE) captures documentation occurring during the encounter; documented by discharge (DBD) includes DDE plus documentation occurring any time prior to admission; and reviewed during encounter (RDE) captures whether anyone reviewed documented data—for the newly available structured SDOH fields and 4 other comparator SDOH data types (problem list, inpatient nursing question, social history free text, and social work notes) on a hospital encounter basis (with patient-year metrics in the Supplementary Appendix). Our sample included all patients (n\,=\,27 127) with at least one hospitalization at UCSF Health (a large, urban, tertiary medical center) over a 1-year period.We observed substantial variation in the use of different SDOH EHR data types. Notably, social history question fields (newly added at study period start) were rarely used (DDE: 0.03\% of encounters, DBD: 0.26\%, RDE: 0.03\%). Free-text patient social history fields had higher use (DDE: 12.1\%, DBD: 49.0\%, RDE: 14.4\%).Our measures of real-world SDOH data use can guide current efforts to capture and leverage these data. For our institution, measures revealed substantial variation across data types, suggesting the need to engage in efforts such as EHR-user education and targeted workflow integration.Measures revealed opportunities to optimize SDOH data documentation and review.}
      \field{day}{1}
      \field{issn}{1527-974X}
      \field{journaltitle}{Journal of the American Medical Informatics Association}
      \field{month}{12}
      \field{number}{12}
      \field{shortjournal}{Journal of the American Medical Informatics Association}
      \field{shorttitle}{Documentation and Review of Social Determinants of Health Data in the {{EHR}}}
      \field{title}{Documentation and Review of Social Determinants of Health Data in the {{EHR}}: Measures and Associated Insights}
      \field{urlday}{18}
      \field{urlmonth}{3}
      \field{urlyear}{2025}
      \field{volume}{28}
      \field{year}{2021}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \field{pages}{2608\bibrangedash 2616}
      \range{pages}{9}
      \verb{doi}
      \verb 10.1093/jamia/ocab194
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/XVJ75RQE/Wang et al. - 2021 - Documentation and review of social determinants of health data in the EHR measures and associated i.pdf;/Users/landes/opt/var/zotero/storage/E29CTNEP/6373497.html
      \endverb
      \verb{urlraw}
      \verb https://doi.org/10.1093/jamia/ocab194
      \endverb
      \verb{url}
      \verb https://doi.org/10.1093/jamia/ocab194
      \endverb
    \endentry
    \entry{goldAdoptionSocialDeterminants2018}{article}{}
      \name{author}{13}{}{%
        {{hash=fafa3d6f03f039972195cbfe9a0cfd5b}{%
           family={Gold},
           familyi={G\bibinitperiod},
           given={Rachel},
           giveni={R\bibinitperiod}}}%
        {{hash=9739bf2e3ce3b80df4b468dca0b86ae2}{%
           family={Bunce},
           familyi={B\bibinitperiod},
           given={Arwen},
           giveni={A\bibinitperiod}}}%
        {{hash=d6067d323403f10a7fdbeb392805e48d}{%
           family={Cowburn},
           familyi={C\bibinitperiod},
           given={Stuart},
           giveni={S\bibinitperiod}}}%
        {{hash=3e0af9d06080d4b8cdc84b3507898d06}{%
           family={Dambrun},
           familyi={D\bibinitperiod},
           given={Katie},
           giveni={K\bibinitperiod}}}%
        {{hash=fec141c85f9f99f518024d17d916e303}{%
           family={Dearing},
           familyi={D\bibinitperiod},
           given={Marla},
           giveni={M\bibinitperiod}}}%
        {{hash=578bf730048040ef0d25a6151b809115}{%
           family={Middendorf},
           familyi={M\bibinitperiod},
           given={Mary},
           giveni={M\bibinitperiod}}}%
        {{hash=3eecc708b0dec7f3e83d52465f1cc83a}{%
           family={Mossman},
           familyi={M\bibinitperiod},
           given={Ned},
           giveni={N\bibinitperiod}}}%
        {{hash=47d9443ea7f3b31847ef7966ef0b8c32}{%
           family={Hollombe},
           familyi={H\bibinitperiod},
           given={Celine},
           giveni={C\bibinitperiod}}}%
        {{hash=e56b6a41f36c2e6ba973c814e5d601dc}{%
           family={Mahr},
           familyi={M\bibinitperiod},
           given={Peter},
           giveni={P\bibinitperiod}}}%
        {{hash=52009410eb5b2ba7aa44db7729b51d3e}{%
           family={Melgar},
           familyi={M\bibinitperiod},
           given={Gerardo},
           giveni={G\bibinitperiod}}}%
        {{hash=55844b5e6e88aae765588dd1d8e21c8d}{%
           family={Davis},
           familyi={D\bibinitperiod},
           given={James},
           giveni={J\bibinitperiod}}}%
        {{hash=246da761869bd0de452a86b9f477b4e5}{%
           family={Gottlieb},
           familyi={G\bibinitperiod},
           given={Laura},
           giveni={L\bibinitperiod}}}%
        {{hash=8a0b996b2aeacc6d8cbaf4ebb897545c}{%
           family={Cottrell},
           familyi={C\bibinitperiod},
           given={Erika},
           giveni={E\bibinitperiod}}}%
      }
      \list{publisher}{1}{%
        {The Annals of Family Medicine}%
      }
      \strng{namehash}{c5535f44c9a2b0db368cc61bd849a9bb}
      \strng{fullhash}{406d1d4540a82d29010c0150deebde65}
      \strng{bibnamehash}{c5535f44c9a2b0db368cc61bd849a9bb}
      \strng{authorbibnamehash}{c5535f44c9a2b0db368cc61bd849a9bb}
      \strng{authornamehash}{c5535f44c9a2b0db368cc61bd849a9bb}
      \strng{authorfullhash}{406d1d4540a82d29010c0150deebde65}
      \field{sortinit}{4}
      \field{sortinithash}{9381316451d1b9788675a07e972a12a7}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{abstract}{PURPOSE This pilot study assessed the feasibility of implementing electronic health record (EHR) tools for collecting, reviewing, and acting on patient-reported social determinants of health (SDH) data in community health centers (CHCs). We believe it is the first such US study. METHODS We implemented a suite of SDH data tools in 3 Pacific Northwest CHCs in June 2016, and used mixed methods to assess their adoption through July 2017. We modified the tools at clinic request; for example, we added questions that ask if the patient wanted assistance with SDH needs. RESULTS Social determinants of health data were collected on 1,130 patients during the study period; 97\% to 99\% of screened patients (n = 1,098) had ≥1 SDH need documented in the EHR, of whom 211 (19\%) had an EHR-documented SDH referral. Only 15\% to 21\% of patients with a documented SDH need indicated wanting help. Examples of lessons learned on adoption of EHR SDH tools indicate that clinics should: consider how to best integrate tools into existing workflow processes; ensure that staff tasked with SDH efforts receive adequate tool training and access; and consider that timing of data entry impacts how and when SDH data can be used. CONCLUSIONS Our results indicate that adoption of systematic EHR-based SDH documentation may be feasible, but substantial barriers to adoption exist. Lessons from this study may inform primary care providers seeking to implement SDH-related efforts, and related health policies. Far more research is needed to address implementation barriers related to SDH documentation in EHRs.}
      \field{day}{1}
      \field{eprinttype}{pubmed}
      \field{issn}{1544-1709, 1544-1717}
      \field{journaltitle}{The Annals of Family Medicine}
      \field{langid}{english}
      \field{month}{9}
      \field{number}{5}
      \field{title}{Adoption of {{Social Determinants}} of {{Health EHR Tools}} by {{Community Health Centers}}}
      \field{urlday}{18}
      \field{urlmonth}{3}
      \field{urlyear}{2025}
      \field{volume}{16}
      \field{year}{2018}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \field{pages}{399\bibrangedash 407}
      \range{pages}{9}
      \verb{doi}
      \verb 10.1370/afm.2275
      \endverb
      \verb{eprint}
      \verb 30201636
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/IPA296LE/Gold et al. - 2018 - Adoption of Social Determinants of Health EHR Tools by Community Health Centers.pdf
      \endverb
      \verb{urlraw}
      \verb https://www.annfammed.org/content/16/5/399
      \endverb
      \verb{url}
      \verb https://www.annfammed.org/content/16/5/399
      \endverb
      \keyw{community health centers,electronic health records,implementation,social determinants of health}
    \endentry
    \entry{guevaraLargeLanguageModels2024}{article}{}
      \name{author}{15}{}{%
        {{hash=0084ad7c48ec7335059f62b5b3da3e65}{%
           family={Guevara},
           familyi={G\bibinitperiod},
           given={Marco},
           giveni={M\bibinitperiod}}}%
        {{hash=83a50488c5c529f30eeb030cbc13a67e}{%
           family={Chen},
           familyi={C\bibinitperiod},
           given={Shan},
           giveni={S\bibinitperiod}}}%
        {{hash=0f44696b1fdfd82fbff117ba201c8d5e}{%
           family={Thomas},
           familyi={T\bibinitperiod},
           given={Spencer},
           giveni={S\bibinitperiod}}}%
        {{hash=95261b210bc3d0e1cb6b590f33f493ee}{%
           family={Chaunzwa},
           familyi={C\bibinitperiod},
           given={Tafadzwa\bibnamedelima L.},
           giveni={T\bibinitperiod\bibinitdelim L\bibinitperiod}}}%
        {{hash=216504fd38a657b4bf362f4ff48b9da9}{%
           family={Franco},
           familyi={F\bibinitperiod},
           given={Idalid},
           giveni={I\bibinitperiod}}}%
        {{hash=d805b8d2b5b8ebb85f153aba41d6b628}{%
           family={Kann},
           familyi={K\bibinitperiod},
           given={Benjamin\bibnamedelima H.},
           giveni={B\bibinitperiod\bibinitdelim H\bibinitperiod}}}%
        {{hash=fc8e94b2cb2e672df8300739a9e924b2}{%
           family={Moningi},
           familyi={M\bibinitperiod},
           given={Shalini},
           giveni={S\bibinitperiod}}}%
        {{hash=7593ae83c290c2c23c5563792c37b6a5}{%
           family={Qian},
           familyi={Q\bibinitperiod},
           given={Jack\bibnamedelima M.},
           giveni={J\bibinitperiod\bibinitdelim M\bibinitperiod}}}%
        {{hash=4ed57b4a5bcae1c87ccfa6c90f33a8f2}{%
           family={Goldstein},
           familyi={G\bibinitperiod},
           given={Madeleine},
           giveni={M\bibinitperiod}}}%
        {{hash=35ca505880fa419e5add25b5d962b06f}{%
           family={Harper},
           familyi={H\bibinitperiod},
           given={Susan},
           giveni={S\bibinitperiod}}}%
        {{hash=7e34b4848990516b8fb636b59d4efaf2}{%
           family={Aerts},
           familyi={A\bibinitperiod},
           given={Hugo\bibnamedelimb J.\bibnamedelimi W.\bibnamedelimi L.},
           giveni={H\bibinitperiod\bibinitdelim J\bibinitperiod\bibinitdelim W\bibinitperiod\bibinitdelim L\bibinitperiod}}}%
        {{hash=871fa31b4e613f1f8af97f7ad5aec7cb}{%
           family={Catalano},
           familyi={C\bibinitperiod},
           given={Paul\bibnamedelima J.},
           giveni={P\bibinitperiod\bibinitdelim J\bibinitperiod}}}%
        {{hash=50fde930e06dd881d9a1d0f18bd12a71}{%
           family={Savova},
           familyi={S\bibinitperiod},
           given={Guergana\bibnamedelima K.},
           giveni={G\bibinitperiod\bibinitdelim K\bibinitperiod}}}%
        {{hash=c9b89fdb93bab884d0b97fe1b46f986a}{%
           family={Mak},
           familyi={M\bibinitperiod},
           given={Raymond\bibnamedelima H.},
           giveni={R\bibinitperiod\bibinitdelim H\bibinitperiod}}}%
        {{hash=9ff12b401fee2e13b7c2fa36782d9cd3}{%
           family={Bitterman},
           familyi={B\bibinitperiod},
           given={Danielle\bibnamedelima S.},
           giveni={D\bibinitperiod\bibinitdelim S\bibinitperiod}}}%
      }
      \list{publisher}{1}{%
        {Nature Publishing Group}%
      }
      \strng{namehash}{d4c3c36548b5cd73b805452ed8c4b417}
      \strng{fullhash}{2cb18eb961e52f28bebe5c11d9adc3fc}
      \strng{bibnamehash}{d4c3c36548b5cd73b805452ed8c4b417}
      \strng{authorbibnamehash}{d4c3c36548b5cd73b805452ed8c4b417}
      \strng{authornamehash}{d4c3c36548b5cd73b805452ed8c4b417}
      \strng{authorfullhash}{2cb18eb961e52f28bebe5c11d9adc3fc}
      \field{sortinit}{5}
      \field{sortinithash}{20e9b4b0b173788c5dace24730f47d8c}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{abstract}{Social determinants of health (SDoH) play a critical role in patient outcomes, yet their documentation is often missing or incomplete in the structured data of electronic health records (EHRs). Large language models (LLMs) could enable high-throughput extraction of SDoH from the EHR to support research and clinical care. However, class imbalance and data limitations present challenges for this sparsely documented yet critical information. Here, we investigated the optimal methods for using LLMs to extract six SDoH categories from narrative text in the EHR: employment, housing, transportation, parental status, relationship, and social support. The best-performing models were fine-tuned Flan-T5 XL for any SDoH mentions (macro-F1 0.71), and Flan-T5 XXL for adverse SDoH mentions (macro-F1 0.70). Adding LLM-generated synthetic data to training varied across models and architecture, but improved the performance of smaller Flan-T5 models (delta F1\,+\,0.12 to +0.23). Our best-fine-tuned models outperformed zero- and few-shot performance of ChatGPT-family models in the zero- and few-shot setting, except GPT4 with 10-shot prompting for adverse SDoH. Fine-tuned models were less likely than ChatGPT to change their prediction when race/ethnicity and gender descriptors were added to the text, suggesting less algorithmic bias (p\,{$<$}\,0.05). Our models identified 93.8\% of patients with adverse SDoH, while ICD-10 codes captured 2.0\%. These results demonstrate the potential of LLMs in improving real-world evidence on SDoH and assisting in identifying patients who could benefit from resource support.}
      \field{day}{11}
      \field{issn}{2398-6352}
      \field{journaltitle}{npj Digital Medicine}
      \field{langid}{english}
      \field{month}{1}
      \field{number}{1}
      \field{shortjournal}{npj Digit. Med.}
      \field{title}{Large Language Models to Identify Social Determinants of Health in Electronic Health Records}
      \field{urlday}{24}
      \field{urlmonth}{9}
      \field{urlyear}{2024}
      \field{volume}{7}
      \field{year}{2024}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \field{pages}{1\bibrangedash 14}
      \range{pages}{14}
      \verb{doi}
      \verb 10.1038/s41746-023-00970-0
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/JLAK48Q7/Guevara et al. - 2024 - Large language models to identify social determinants of health in electronic health records.pdf
      \endverb
      \verb{urlraw}
      \verb https://www.nature.com/articles/s41746-023-00970-0
      \endverb
      \verb{url}
      \verb https://www.nature.com/articles/s41746-023-00970-0
      \endverb
      \keyw{Health care,Machine learning}
    \endentry
    \entry{lituievAutomaticExtractionSocial2023}{article}{}
      \name{author}{6}{}{%
        {{hash=2f9d1b43bec21dbf18154a46979678a1}{%
           family={Lituiev},
           familyi={L\bibinitperiod},
           given={Dmytro\bibnamedelima S.},
           giveni={D\bibinitperiod\bibinitdelim S\bibinitperiod}}}%
        {{hash=0136bc9dc03e6dbad1aa416e7c2860ef}{%
           family={Lacar},
           familyi={L\bibinitperiod},
           given={Benjamin},
           giveni={B\bibinitperiod}}}%
        {{hash=3ba488e457f7ad90debfe9fb7e49acd1}{%
           family={Pak},
           familyi={P\bibinitperiod},
           given={Sang},
           giveni={S\bibinitperiod}}}%
        {{hash=b9732585d9cb83c9ca11c16ad46ed367}{%
           family={Abramowitsch},
           familyi={A\bibinitperiod},
           given={Peter\bibnamedelima L.},
           giveni={P\bibinitperiod\bibinitdelim L\bibinitperiod}}}%
        {{hash=7705d63f30ac3d1c4d5c687d7e994e0a}{%
           family={Marchis},
           familyi={M\bibinitperiod},
           given={Emilia\bibnamedelimb H.\bibnamedelimi De},
           giveni={E\bibinitperiod\bibinitdelim H\bibinitperiod\bibinitdelim D\bibinitperiod}}}%
        {{hash=033086bd36b1db5ed09eaca1534fb3ed}{%
           family={Peterson},
           familyi={P\bibinitperiod},
           given={Thomas\bibnamedelima A.},
           giveni={T\bibinitperiod\bibinitdelim A\bibinitperiod}}}%
      }
      \strng{namehash}{c63a9bfcad2a137976a95323e1e33fe8}
      \strng{fullhash}{224cf575670056b333deff03043c1eab}
      \strng{bibnamehash}{c63a9bfcad2a137976a95323e1e33fe8}
      \strng{authorbibnamehash}{c63a9bfcad2a137976a95323e1e33fe8}
      \strng{authornamehash}{c63a9bfcad2a137976a95323e1e33fe8}
      \strng{authorfullhash}{224cf575670056b333deff03043c1eab}
      \field{sortinit}{5}
      \field{sortinithash}{20e9b4b0b173788c5dace24730f47d8c}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{abstract}{We applied natural language processing and inference methods to extract social determinants of health (SDoH) information from clinical notes of patients with chronic low back pain (cLBP) to enhance future analyses of the associations between SDoH ...}
      \field{day}{13}
      \field{eprinttype}{pubmed}
      \field{journaltitle}{Journal of the American Medical Informatics Association : JAMIA}
      \field{langid}{english}
      \field{month}{5}
      \field{number}{8}
      \field{title}{Automatic Extraction of Social Determinants of Health from Medical Notes of Chronic Lower Back Pain Patients}
      \field{urlday}{15}
      \field{urlmonth}{11}
      \field{urlyear}{2024}
      \field{volume}{30}
      \field{year}{2023}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \field{pages}{1438}
      \range{pages}{1}
      \verb{doi}
      \verb 10.1093/jamia/ocad054
      \endverb
      \verb{eprint}
      \verb 37080559
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/DI2W4AY8/Lituiev et al. - 2023 - Automatic extraction of social determinants of health from medical notes of chronic lower back pain.pdf
      \endverb
      \verb{urlraw}
      \verb https://pmc.ncbi.nlm.nih.gov/articles/PMC10354762/
      \endverb
      \verb{url}
      \verb https://pmc.ncbi.nlm.nih.gov/articles/PMC10354762/
      \endverb
    \endentry
    \entry{johnsonMIMICIIIFreelyAccessible2016}{article}{}
      \name{author}{10}{}{%
        {{hash=97ddf9ef7b3f83671aa14334972e8186}{%
           family={Johnson},
           familyi={J\bibinitperiod},
           given={Alistair\bibnamedelimb E.\bibnamedelimi W.},
           giveni={A\bibinitperiod\bibinitdelim E\bibinitperiod\bibinitdelim W\bibinitperiod}}}%
        {{hash=b1a10559d1345954860fcb71d58d644b}{%
           family={Pollard},
           familyi={P\bibinitperiod},
           given={Tom\bibnamedelima J.},
           giveni={T\bibinitperiod\bibinitdelim J\bibinitperiod}}}%
        {{hash=905fd330076c29b21add0f3e7108629d}{%
           family={Shen},
           familyi={S\bibinitperiod},
           given={Lu},
           giveni={L\bibinitperiod}}}%
        {{hash=2ea8fc75e44631dccd4c8217117062f2}{%
           family={Lehman},
           familyi={L\bibinitperiod},
           given={Li-wei\bibnamedelima H.},
           giveni={L\bibinithyphendelim w\bibinitperiod\bibinitdelim H\bibinitperiod}}}%
        {{hash=6aa84d1af8a9f95dddedc1677244afbe}{%
           family={Feng},
           familyi={F\bibinitperiod},
           given={Mengling},
           giveni={M\bibinitperiod}}}%
        {{hash=b576d328e9b0f4401d1363e5a30441ac}{%
           family={Ghassemi},
           familyi={G\bibinitperiod},
           given={Mohammad},
           giveni={M\bibinitperiod}}}%
        {{hash=64d84f6b7d6b1cd1b82470cd4f4661b0}{%
           family={Moody},
           familyi={M\bibinitperiod},
           given={Benjamin},
           giveni={B\bibinitperiod}}}%
        {{hash=e4ec701f3e9b3400f41c7dcb84d2e88a}{%
           family={Szolovits},
           familyi={S\bibinitperiod},
           given={Peter},
           giveni={P\bibinitperiod}}}%
        {{hash=f0e3dac1adc983d78b53e594ecb6d1dc}{%
           family={Celi},
           familyi={C\bibinitperiod},
           given={Leo\bibnamedelima Anthony},
           giveni={L\bibinitperiod\bibinitdelim A\bibinitperiod}}}%
        {{hash=2193bac90baddb616fc4dcd2f366de81}{%
           family={Mark},
           familyi={M\bibinitperiod},
           given={Roger\bibnamedelima G.},
           giveni={R\bibinitperiod\bibinitdelim G\bibinitperiod}}}%
      }
      \list{publisher}{1}{%
        {Nature Publishing Group}%
      }
      \strng{namehash}{2dc9d6f36765f978f5cd24a236e1c1e5}
      \strng{fullhash}{924ec116ee95765e276c886e99423344}
      \strng{bibnamehash}{2dc9d6f36765f978f5cd24a236e1c1e5}
      \strng{authorbibnamehash}{2dc9d6f36765f978f5cd24a236e1c1e5}
      \strng{authornamehash}{2dc9d6f36765f978f5cd24a236e1c1e5}
      \strng{authorfullhash}{924ec116ee95765e276c886e99423344}
      \field{sortinit}{3}
      \field{sortinithash}{ad6fe7482ffbd7b9f99c9e8b5dccd3d7}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{abstract}{Design Type(s) data integration objective Measurement Type(s) Demographics • clinical measurement • intervention • Billing • Medical History Dictionary • Pharmacotherapy • clinical laboratory test • medical data Technology Type(s) Electronic Medical Record • Medical Record • Electronic Billing System • Medical Coding Process Document • Free Text Format Factor Type(s) Sample Characteristic(s) Homo sapiens Machine-accessible metadata file describing the reported data (ISA-Tab format)}
      \field{day}{24}
      \field{issn}{2052-4463}
      \field{issue}{1}
      \field{journaltitle}{Scientific Data}
      \field{langid}{english}
      \field{month}{5}
      \field{number}{1}
      \field{shortjournal}{Sci Data}
      \field{title}{{{MIMIC-III}}, a Freely Accessible Critical Care Database}
      \field{urlday}{26}
      \field{urlmonth}{3}
      \field{urlyear}{2020}
      \field{volume}{3}
      \field{year}{2016}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \field{pages}{1\bibrangedash 9}
      \range{pages}{9}
      \verb{doi}
      \verb 10.1038/sdata.2016.35
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/WBQ3WJUN/Johnson et al. - 2016 - MIMIC-III, a freely accessible critical care datab.pdf;/Users/landes/opt/var/zotero/storage/AB7YMAGV/sdata201635.html
      \endverb
      \verb{urlraw}
      \verb https://www.nature.com/articles/sdata201635/
      \endverb
      \verb{url}
      \verb https://www.nature.com/articles/sdata201635/
      \endverb
    \endentry
    \entry{grattafioriLlama3Herd2024}{misc}{}
      \name{author}{561}{}{%
        {{hash=7ac1dd876daaa34de14a8cf2eb49039c}{%
           family={Grattafiori},
           familyi={G\bibinitperiod},
           given={Aaron},
           giveni={A\bibinitperiod}}}%
        {{hash=517ae3236e034cf4fdea5b47025e3973}{%
           family={Dubey},
           familyi={D\bibinitperiod},
           given={Abhimanyu},
           giveni={A\bibinitperiod}}}%
        {{hash=7cd1f80eda1bcdcfef29a10ede4dd146}{%
           family={Jauhri},
           familyi={J\bibinitperiod},
           given={Abhinav},
           giveni={A\bibinitperiod}}}%
        {{hash=06842da7f77ff44040c8321fd64885f3}{%
           family={Pandey},
           familyi={P\bibinitperiod},
           given={Abhinav},
           giveni={A\bibinitperiod}}}%
        {{hash=608d46a077e616c07f7f9f841f4de3ae}{%
           family={Kadian},
           familyi={K\bibinitperiod},
           given={Abhishek},
           giveni={A\bibinitperiod}}}%
        {{hash=2e761a0ae1d9bbf5f560537144813f20}{%
           family={Al-Dahle},
           familyi={A\bibinithyphendelim D\bibinitperiod},
           given={Ahmad},
           giveni={A\bibinitperiod}}}%
        {{hash=1debd101fb9be92bb0eece4c427841d9}{%
           family={Letman},
           familyi={L\bibinitperiod},
           given={Aiesha},
           giveni={A\bibinitperiod}}}%
        {{hash=457cd19c088f0576b2d4d9823277fe38}{%
           family={Mathur},
           familyi={M\bibinitperiod},
           given={Akhil},
           giveni={A\bibinitperiod}}}%
        {{hash=a7fbe7fc6a5ce250cabe9388e690c55b}{%
           family={Schelten},
           familyi={S\bibinitperiod},
           given={Alan},
           giveni={A\bibinitperiod}}}%
        {{hash=6513aec94043b0b10600196df6026a8c}{%
           family={Vaughan},
           familyi={V\bibinitperiod},
           given={Alex},
           giveni={A\bibinitperiod}}}%
        {{hash=d5eae71ab93d6aef82689401f1018de6}{%
           family={Yang},
           familyi={Y\bibinitperiod},
           given={Amy},
           giveni={A\bibinitperiod}}}%
        {{hash=277117db6b938bd36379979ac719cc02}{%
           family={Fan},
           familyi={F\bibinitperiod},
           given={Angela},
           giveni={A\bibinitperiod}}}%
        {{hash=eb6a43771a55bde951c0119ac5c7ad13}{%
           family={Goyal},
           familyi={G\bibinitperiod},
           given={Anirudh},
           giveni={A\bibinitperiod}}}%
        {{hash=83b44b72b8c1a3fa66c344f8314ae0ea}{%
           family={Hartshorn},
           familyi={H\bibinitperiod},
           given={Anthony},
           giveni={A\bibinitperiod}}}%
        {{hash=406e630aa8ec4a134f9d7368afbfba7d}{%
           family={Yang},
           familyi={Y\bibinitperiod},
           given={Aobo},
           giveni={A\bibinitperiod}}}%
        {{hash=9ee5b7c583ffe333cff357d0076583e2}{%
           family={Mitra},
           familyi={M\bibinitperiod},
           given={Archi},
           giveni={A\bibinitperiod}}}%
        {{hash=476c76c4de9ec529afd69122f38f6f2a}{%
           family={Sravankumar},
           familyi={S\bibinitperiod},
           given={Archie},
           giveni={A\bibinitperiod}}}%
        {{hash=897d7f44330ad50e6bbabf2e19436741}{%
           family={Korenev},
           familyi={K\bibinitperiod},
           given={Artem},
           giveni={A\bibinitperiod}}}%
        {{hash=dd42319df6029b8779059366db5bf5a1}{%
           family={Hinsvark},
           familyi={H\bibinitperiod},
           given={Arthur},
           giveni={A\bibinitperiod}}}%
        {{hash=5f597674181132737db0211a957f4dde}{%
           family={Rao},
           familyi={R\bibinitperiod},
           given={Arun},
           giveni={A\bibinitperiod}}}%
        {{hash=983273ab2d972b56d8b64d220726b6aa}{%
           family={Zhang},
           familyi={Z\bibinitperiod},
           given={Aston},
           giveni={A\bibinitperiod}}}%
        {{hash=a829e25f1d50c3545ed8e99f12890acc}{%
           family={Rodriguez},
           familyi={R\bibinitperiod},
           given={Aurelien},
           giveni={A\bibinitperiod}}}%
        {{hash=b2689ee6da3cca0692fb764abee12be3}{%
           family={Gregerson},
           familyi={G\bibinitperiod},
           given={Austen},
           giveni={A\bibinitperiod}}}%
        {{hash=9c93fffb68bf410af913bd94d121f0a9}{%
           family={Spataru},
           familyi={S\bibinitperiod},
           given={Ava},
           giveni={A\bibinitperiod}}}%
        {{hash=5f4e5510fd04af23b103f7b65591a6c1}{%
           family={Roziere},
           familyi={R\bibinitperiod},
           given={Baptiste},
           giveni={B\bibinitperiod}}}%
        {{hash=511a8a03cad821bcb8d968148d173191}{%
           family={Biron},
           familyi={B\bibinitperiod},
           given={Bethany},
           giveni={B\bibinitperiod}}}%
        {{hash=053e8c6174328cafc9566859df3bbe95}{%
           family={Tang},
           familyi={T\bibinitperiod},
           given={Binh},
           giveni={B\bibinitperiod}}}%
        {{hash=1ebb377ae0403a07a7fd272138005880}{%
           family={Chern},
           familyi={C\bibinitperiod},
           given={Bobbie},
           giveni={B\bibinitperiod}}}%
        {{hash=60b0dee36c03f3d79184e3fe4c948885}{%
           family={Caucheteux},
           familyi={C\bibinitperiod},
           given={Charlotte},
           giveni={C\bibinitperiod}}}%
        {{hash=3336eb4e5300d8204ccd75e7b7c6df72}{%
           family={Nayak},
           familyi={N\bibinitperiod},
           given={Chaya},
           giveni={C\bibinitperiod}}}%
        {{hash=e81ac23c5f1addcd3c227114521d590f}{%
           family={Bi},
           familyi={B\bibinitperiod},
           given={Chloe},
           giveni={C\bibinitperiod}}}%
        {{hash=46d5807f87a73a76ecd71aeab5f8bd12}{%
           family={Marra},
           familyi={M\bibinitperiod},
           given={Chris},
           giveni={C\bibinitperiod}}}%
        {{hash=60db036f80713fa213a1b46d1343ab21}{%
           family={McConnell},
           familyi={M\bibinitperiod},
           given={Chris},
           giveni={C\bibinitperiod}}}%
        {{hash=7682db8ac070796c6a652fafec2808c0}{%
           family={Keller},
           familyi={K\bibinitperiod},
           given={Christian},
           giveni={C\bibinitperiod}}}%
        {{hash=9deedad9eadb158dc0b452be1ed5ea8d}{%
           family={Touret},
           familyi={T\bibinitperiod},
           given={Christophe},
           giveni={C\bibinitperiod}}}%
        {{hash=4540e0bc6e94d6172c825c8763ed9ea2}{%
           family={Wu},
           familyi={W\bibinitperiod},
           given={Chunyang},
           giveni={C\bibinitperiod}}}%
        {{hash=d16e7f0423cd1184cb11436b26a1bdaf}{%
           family={Wong},
           familyi={W\bibinitperiod},
           given={Corinne},
           giveni={C\bibinitperiod}}}%
        {{hash=88658b8a76c5ee08e1a06ff9a649912c}{%
           family={Ferrer},
           familyi={F\bibinitperiod},
           given={Cristian\bibnamedelima Canton},
           giveni={C\bibinitperiod\bibinitdelim C\bibinitperiod}}}%
        {{hash=5986b5d4a265702da5b115a74896397b}{%
           family={Nikolaidis},
           familyi={N\bibinitperiod},
           given={Cyrus},
           giveni={C\bibinitperiod}}}%
        {{hash=e55d6988e514e9c72f9fb21f40fb601c}{%
           family={Allonsius},
           familyi={A\bibinitperiod},
           given={Damien},
           giveni={D\bibinitperiod}}}%
        {{hash=55763e73a41d50cc4f9f55a06205cc86}{%
           family={Song},
           familyi={S\bibinitperiod},
           given={Daniel},
           giveni={D\bibinitperiod}}}%
        {{hash=4ed3f3dec5de09d37df1c34480310345}{%
           family={Pintz},
           familyi={P\bibinitperiod},
           given={Danielle},
           giveni={D\bibinitperiod}}}%
        {{hash=96cd5609175a1af286275fdce2035b24}{%
           family={Livshits},
           familyi={L\bibinitperiod},
           given={Danny},
           giveni={D\bibinitperiod}}}%
        {{hash=466c2556f5190f94e1fc1e0e06a9764b}{%
           family={Wyatt},
           familyi={W\bibinitperiod},
           given={Danny},
           giveni={D\bibinitperiod}}}%
        {{hash=8bc68c3d86e021e0a7cf92611aef5aba}{%
           family={Esiobu},
           familyi={E\bibinitperiod},
           given={David},
           giveni={D\bibinitperiod}}}%
        {{hash=43b7c4cd20fa8299528cf96d9b0c15d7}{%
           family={Choudhary},
           familyi={C\bibinitperiod},
           given={Dhruv},
           giveni={D\bibinitperiod}}}%
        {{hash=3a55a24e70b781030f26c1dd27a28d97}{%
           family={Mahajan},
           familyi={M\bibinitperiod},
           given={Dhruv},
           giveni={D\bibinitperiod}}}%
        {{hash=0d327c0fe8637e2c0be9c118c1c6511d}{%
           family={Garcia-Olano},
           familyi={G\bibinithyphendelim O\bibinitperiod},
           given={Diego},
           giveni={D\bibinitperiod}}}%
        {{hash=7ae9cd6ec443d954600e0359962c4bd7}{%
           family={Perino},
           familyi={P\bibinitperiod},
           given={Diego},
           giveni={D\bibinitperiod}}}%
        {{hash=0aab99f9623dcafc949b52e6684d9156}{%
           family={Hupkes},
           familyi={H\bibinitperiod},
           given={Dieuwke},
           giveni={D\bibinitperiod}}}%
        {{hash=dba4865891705cb4d6b9c7a1035dd965}{%
           family={Lakomkin},
           familyi={L\bibinitperiod},
           given={Egor},
           giveni={E\bibinitperiod}}}%
        {{hash=14fd96b159eafa3f79e3845a4c443ee9}{%
           family={AlBadawy},
           familyi={A\bibinitperiod},
           given={Ehab},
           giveni={E\bibinitperiod}}}%
        {{hash=3591ba031dfc34f415377df95ca974e8}{%
           family={Lobanova},
           familyi={L\bibinitperiod},
           given={Elina},
           giveni={E\bibinitperiod}}}%
        {{hash=9d9aa89c5300a6b631bd2c11e1a5ecb5}{%
           family={Dinan},
           familyi={D\bibinitperiod},
           given={Emily},
           giveni={E\bibinitperiod}}}%
        {{hash=d3a381f971b5c6215ca00dbab6af16bc}{%
           family={Smith},
           familyi={S\bibinitperiod},
           given={Eric\bibnamedelima Michael},
           giveni={E\bibinitperiod\bibinitdelim M\bibinitperiod}}}%
        {{hash=c05b7cdee97bbf89a8dcbbc2cba01248}{%
           family={Radenovic},
           familyi={R\bibinitperiod},
           given={Filip},
           giveni={F\bibinitperiod}}}%
        {{hash=f2e3a540fe772c40c15564f8e6056c14}{%
           family={Guzmán},
           familyi={G\bibinitperiod},
           given={Francisco},
           giveni={F\bibinitperiod}}}%
        {{hash=c36fa1678a66294c4e052073505e741f}{%
           family={Zhang},
           familyi={Z\bibinitperiod},
           given={Frank},
           giveni={F\bibinitperiod}}}%
        {{hash=a345e20a460089c920bb74098ed450db}{%
           family={Synnaeve},
           familyi={S\bibinitperiod},
           given={Gabriel},
           giveni={G\bibinitperiod}}}%
        {{hash=446d55de31cf6d76503f570d8d0e1945}{%
           family={Lee},
           familyi={L\bibinitperiod},
           given={Gabrielle},
           giveni={G\bibinitperiod}}}%
        {{hash=d55a7c283d9d7ec492662bd4fb221ce8}{%
           family={Anderson},
           familyi={A\bibinitperiod},
           given={Georgia\bibnamedelima Lewis},
           giveni={G\bibinitperiod\bibinitdelim L\bibinitperiod}}}%
        {{hash=0224eebd162ebf106ab6e6cf381c31f3}{%
           family={Thattai},
           familyi={T\bibinitperiod},
           given={Govind},
           giveni={G\bibinitperiod}}}%
        {{hash=3f24f43e1cf4e0195bd44a1bfbaa7a63}{%
           family={Nail},
           familyi={N\bibinitperiod},
           given={Graeme},
           giveni={G\bibinitperiod}}}%
        {{hash=b8a7ca70cb43965a42b9c6eb0bf53947}{%
           family={Mialon},
           familyi={M\bibinitperiod},
           given={Gregoire},
           giveni={G\bibinitperiod}}}%
        {{hash=5b08b637a3bab8f27d66577f48f39899}{%
           family={Pang},
           familyi={P\bibinitperiod},
           given={Guan},
           giveni={G\bibinitperiod}}}%
        {{hash=0904c97caab4d6e021d459b4326fa0ac}{%
           family={Cucurell},
           familyi={C\bibinitperiod},
           given={Guillem},
           giveni={G\bibinitperiod}}}%
        {{hash=239b8e5169e07c88a99c57cd2ab79bc2}{%
           family={Nguyen},
           familyi={N\bibinitperiod},
           given={Hailey},
           giveni={H\bibinitperiod}}}%
        {{hash=dfba7677fba7e4dc8b94d5c94ee12cfe}{%
           family={Korevaar},
           familyi={K\bibinitperiod},
           given={Hannah},
           giveni={H\bibinitperiod}}}%
        {{hash=e33632a7cd83c6e486ccbe7fd081f315}{%
           family={Xu},
           familyi={X\bibinitperiod},
           given={Hu},
           giveni={H\bibinitperiod}}}%
        {{hash=a2a13fcd633ec70c55a7f3f4812afdcf}{%
           family={Touvron},
           familyi={T\bibinitperiod},
           given={Hugo},
           giveni={H\bibinitperiod}}}%
        {{hash=93956bb0eb985aaa3bc14fd1e311e982}{%
           family={Zarov},
           familyi={Z\bibinitperiod},
           given={Iliyan},
           giveni={I\bibinitperiod}}}%
        {{hash=9671ba761407bb5cd4695fe9f7cada99}{%
           family={Ibarra},
           familyi={I\bibinitperiod},
           given={Imanol\bibnamedelima Arrieta},
           giveni={I\bibinitperiod\bibinitdelim A\bibinitperiod}}}%
        {{hash=ce85bd2d98b3f94c341b59edaa214e3d}{%
           family={Kloumann},
           familyi={K\bibinitperiod},
           given={Isabel},
           giveni={I\bibinitperiod}}}%
        {{hash=4ada721a93e1592ecdc3df0fc9876469}{%
           family={Misra},
           familyi={M\bibinitperiod},
           given={Ishan},
           giveni={I\bibinitperiod}}}%
        {{hash=f9a895918de323357927b1d34c9f157c}{%
           family={Evtimov},
           familyi={E\bibinitperiod},
           given={Ivan},
           giveni={I\bibinitperiod}}}%
        {{hash=559dbff158ab66686ed5993199a83db3}{%
           family={Zhang},
           familyi={Z\bibinitperiod},
           given={Jack},
           giveni={J\bibinitperiod}}}%
        {{hash=754f41410033ef892e9ec8406be562b1}{%
           family={Copet},
           familyi={C\bibinitperiod},
           given={Jade},
           giveni={J\bibinitperiod}}}%
        {{hash=fad5846abebb04ef9424a83e9c98be58}{%
           family={Lee},
           familyi={L\bibinitperiod},
           given={Jaewon},
           giveni={J\bibinitperiod}}}%
        {{hash=783239a28c3499d058b735eae1106637}{%
           family={Geffert},
           familyi={G\bibinitperiod},
           given={Jan},
           giveni={J\bibinitperiod}}}%
        {{hash=c4c153a694c02a74a0a274c73e6441f2}{%
           family={Vranes},
           familyi={V\bibinitperiod},
           given={Jana},
           giveni={J\bibinitperiod}}}%
        {{hash=dac470c32dedad932ab1af9c3260bb72}{%
           family={Park},
           familyi={P\bibinitperiod},
           given={Jason},
           giveni={J\bibinitperiod}}}%
        {{hash=9a1db2f2823684340e000e50c6208a1f}{%
           family={Mahadeokar},
           familyi={M\bibinitperiod},
           given={Jay},
           giveni={J\bibinitperiod}}}%
        {{hash=aeee6e510ec84f70732dea374d8a5ed2}{%
           family={Shah},
           familyi={S\bibinitperiod},
           given={Jeet},
           giveni={J\bibinitperiod}}}%
        {{hash=99f3ebed2f6b73f262331b1ad545a6df}{%
           family={Linde},
           familyi={L\bibinitperiod},
           given={Jelmer},
           giveni={J\bibinitperiod},
           prefix={van\bibnamedelima der},
           prefixi={v\bibinitperiod\bibinitdelim d\bibinitperiod}}}%
        {{hash=8addaf2119b976c360fac666e552339d}{%
           family={Billock},
           familyi={B\bibinitperiod},
           given={Jennifer},
           giveni={J\bibinitperiod}}}%
        {{hash=faf318ef4acda4567253c563b330f7ff}{%
           family={Hong},
           familyi={H\bibinitperiod},
           given={Jenny},
           giveni={J\bibinitperiod}}}%
        {{hash=6ce116cb36b1ac6aa9dd9ea8b552ea39}{%
           family={Lee},
           familyi={L\bibinitperiod},
           given={Jenya},
           giveni={J\bibinitperiod}}}%
        {{hash=76c6af62ff4da9d3f19d41b4e8d2bbc1}{%
           family={Fu},
           familyi={F\bibinitperiod},
           given={Jeremy},
           giveni={J\bibinitperiod}}}%
        {{hash=3a14f76bc40e8aa0a4eccb67be887f86}{%
           family={Chi},
           familyi={C\bibinitperiod},
           given={Jianfeng},
           giveni={J\bibinitperiod}}}%
        {{hash=4d5dd7060b67c3b1f62b82e0dea2a4e0}{%
           family={Huang},
           familyi={H\bibinitperiod},
           given={Jianyu},
           giveni={J\bibinitperiod}}}%
        {{hash=451d91a5bd40575b8fa58bfe8d336090}{%
           family={Liu},
           familyi={L\bibinitperiod},
           given={Jiawen},
           giveni={J\bibinitperiod}}}%
        {{hash=fcd6114a30fda9801eef65b9d374f56b}{%
           family={Wang},
           familyi={W\bibinitperiod},
           given={Jie},
           giveni={J\bibinitperiod}}}%
        {{hash=aefd0dd76e8ae7b871a4bea7623fe602}{%
           family={Yu},
           familyi={Y\bibinitperiod},
           given={Jiecao},
           giveni={J\bibinitperiod}}}%
        {{hash=2a689adc56bc1cd7ef1a5d47c4f2a1c2}{%
           family={Bitton},
           familyi={B\bibinitperiod},
           given={Joanna},
           giveni={J\bibinitperiod}}}%
        {{hash=4a27a3fc7c2e8cf8a844a8ecd54e919d}{%
           family={Spisak},
           familyi={S\bibinitperiod},
           given={Joe},
           giveni={J\bibinitperiod}}}%
        {{hash=d453b06ade17d41da4d373ecf988e52a}{%
           family={Park},
           familyi={P\bibinitperiod},
           given={Jongsoo},
           giveni={J\bibinitperiod}}}%
        {{hash=6aaaea242a73e6eea97578d681468442}{%
           family={Rocca},
           familyi={R\bibinitperiod},
           given={Joseph},
           giveni={J\bibinitperiod}}}%
        {{hash=ca81589cf7cac022f06650385c8b9d05}{%
           family={Johnstun},
           familyi={J\bibinitperiod},
           given={Joshua},
           giveni={J\bibinitperiod}}}%
        {{hash=ebddaeb491ec309604315869c03f5fb6}{%
           family={Saxe},
           familyi={S\bibinitperiod},
           given={Joshua},
           giveni={J\bibinitperiod}}}%
        {{hash=0fdda3217c25f869c66e0f1f0a9816b6}{%
           family={Jia},
           familyi={J\bibinitperiod},
           given={Junteng},
           giveni={J\bibinitperiod}}}%
        {{hash=dbea60af0097d26182dbc78d209e116e}{%
           family={Alwala},
           familyi={A\bibinitperiod},
           given={Kalyan\bibnamedelima Vasuden},
           giveni={K\bibinitperiod\bibinitdelim V\bibinitperiod}}}%
        {{hash=ff03033f89dcfb6e7f181829c584da48}{%
           family={Prasad},
           familyi={P\bibinitperiod},
           given={Karthik},
           giveni={K\bibinitperiod}}}%
        {{hash=02100c17b9904b7c4bf7845fcdf39e55}{%
           family={Upasani},
           familyi={U\bibinitperiod},
           given={Kartikeya},
           giveni={K\bibinitperiod}}}%
        {{hash=36190f678d0db058f91c0fa98d8c2226}{%
           family={Plawiak},
           familyi={P\bibinitperiod},
           given={Kate},
           giveni={K\bibinitperiod}}}%
        {{hash=815a2cdb03036dc2884fcf0472f759cf}{%
           family={Li},
           familyi={L\bibinitperiod},
           given={Ke},
           giveni={K\bibinitperiod}}}%
        {{hash=7335b523d68241b7785091b15c243eac}{%
           family={Heafield},
           familyi={H\bibinitperiod},
           given={Kenneth},
           giveni={K\bibinitperiod}}}%
        {{hash=2f7a28226c3a07d546eb4e727221d2ea}{%
           family={Stone},
           familyi={S\bibinitperiod},
           given={Kevin},
           giveni={K\bibinitperiod}}}%
        {{hash=f83b63a652208c1987868f7712047515}{%
           family={El-Arini},
           familyi={E\bibinithyphendelim A\bibinitperiod},
           given={Khalid},
           giveni={K\bibinitperiod}}}%
        {{hash=3ece0bb6da8d30142a3ff3bce0ff6dc9}{%
           family={Iyer},
           familyi={I\bibinitperiod},
           given={Krithika},
           giveni={K\bibinitperiod}}}%
        {{hash=d2a4ed88a068eabe32304fe58d6e038d}{%
           family={Malik},
           familyi={M\bibinitperiod},
           given={Kshitiz},
           giveni={K\bibinitperiod}}}%
        {{hash=ce78cb6b0c60fa398802dc90a821d318}{%
           family={Chiu},
           familyi={C\bibinitperiod},
           given={Kuenley},
           giveni={K\bibinitperiod}}}%
        {{hash=d8c5cf85374627a5b508c28ec50a61da}{%
           family={Bhalla},
           familyi={B\bibinitperiod},
           given={Kunal},
           giveni={K\bibinitperiod}}}%
        {{hash=90da1abde84b45ee8f620c681a9f2088}{%
           family={Lakhotia},
           familyi={L\bibinitperiod},
           given={Kushal},
           giveni={K\bibinitperiod}}}%
        {{hash=ae95a269f6462af93a8a4e29f0c4c354}{%
           family={Rantala-Yeary},
           familyi={R\bibinithyphendelim Y\bibinitperiod},
           given={Lauren},
           giveni={L\bibinitperiod}}}%
        {{hash=47fbe2837893a84fb516e9e85ba7aa36}{%
           family={Maaten},
           familyi={M\bibinitperiod},
           given={Laurens},
           giveni={L\bibinitperiod},
           prefix={van\bibnamedelima der},
           prefixi={v\bibinitperiod\bibinitdelim d\bibinitperiod}}}%
        {{hash=090a9901d02a0452a90109efa1f31cc7}{%
           family={Chen},
           familyi={C\bibinitperiod},
           given={Lawrence},
           giveni={L\bibinitperiod}}}%
        {{hash=74dd8d145e8762841eba435fa00a9a37}{%
           family={Tan},
           familyi={T\bibinitperiod},
           given={Liang},
           giveni={L\bibinitperiod}}}%
        {{hash=93c5fa87a0065c89150edba624a9d4b4}{%
           family={Jenkins},
           familyi={J\bibinitperiod},
           given={Liz},
           giveni={L\bibinitperiod}}}%
        {{hash=950630d7ca7a0fad0a3d3f705e279eb1}{%
           family={Martin},
           familyi={M\bibinitperiod},
           given={Louis},
           giveni={L\bibinitperiod}}}%
        {{hash=bfecac3687aa510dc501bd584aebd14c}{%
           family={Madaan},
           familyi={M\bibinitperiod},
           given={Lovish},
           giveni={L\bibinitperiod}}}%
        {{hash=6b4ecfbce0b2f5421fca855200ce8402}{%
           family={Malo},
           familyi={M\bibinitperiod},
           given={Lubo},
           giveni={L\bibinitperiod}}}%
        {{hash=8269ea0da45e06632fa2fb6ab5a485f2}{%
           family={Blecher},
           familyi={B\bibinitperiod},
           given={Lukas},
           giveni={L\bibinitperiod}}}%
        {{hash=1d1a22fbe4ec5623497a35cc6b461e93}{%
           family={Landzaat},
           familyi={L\bibinitperiod},
           given={Lukas},
           giveni={L\bibinitperiod}}}%
        {{hash=6716e1a7ecf5c53811aca15e30b84ef1}{%
           family={Oliveira},
           familyi={O\bibinitperiod},
           given={Luke},
           giveni={L\bibinitperiod},
           prefix={de},
           prefixi={d\bibinitperiod}}}%
        {{hash=56b5b1736e48384ef7756cfaa4882fad}{%
           family={Muzzi},
           familyi={M\bibinitperiod},
           given={Madeline},
           giveni={M\bibinitperiod}}}%
        {{hash=d20dbd6636782c062f2caeb8df352784}{%
           family={Pasupuleti},
           familyi={P\bibinitperiod},
           given={Mahesh},
           giveni={M\bibinitperiod}}}%
        {{hash=f0a4c8dfbb53049c09141b32643288b2}{%
           family={Singh},
           familyi={S\bibinitperiod},
           given={Mannat},
           giveni={M\bibinitperiod}}}%
        {{hash=d1976e858e503a89ab7e5fa48734c939}{%
           family={Paluri},
           familyi={P\bibinitperiod},
           given={Manohar},
           giveni={M\bibinitperiod}}}%
        {{hash=71cb443347f4b9392a81d58940afc147}{%
           family={Kardas},
           familyi={K\bibinitperiod},
           given={Marcin},
           giveni={M\bibinitperiod}}}%
        {{hash=69e7c09505863223949fcb52b5d05d89}{%
           family={Tsimpoukelli},
           familyi={T\bibinitperiod},
           given={Maria},
           giveni={M\bibinitperiod}}}%
        {{hash=4cbcb22a60be8a2dea4f6acbcde8bc01}{%
           family={Oldham},
           familyi={O\bibinitperiod},
           given={Mathew},
           giveni={M\bibinitperiod}}}%
        {{hash=e5ce0679abfc2a97fd3e295186868818}{%
           family={Rita},
           familyi={R\bibinitperiod},
           given={Mathieu},
           giveni={M\bibinitperiod}}}%
        {{hash=0afa85890f0145d06e829a82d73ca0df}{%
           family={Pavlova},
           familyi={P\bibinitperiod},
           given={Maya},
           giveni={M\bibinitperiod}}}%
        {{hash=54affa9a2c21ec7e6165e1f0698417b1}{%
           family={Kambadur},
           familyi={K\bibinitperiod},
           given={Melanie},
           giveni={M\bibinitperiod}}}%
        {{hash=c97f53fdeeb04c28de19e3324cb4bc0a}{%
           family={Lewis},
           familyi={L\bibinitperiod},
           given={Mike},
           giveni={M\bibinitperiod}}}%
        {{hash=b2e053cdeb5efd4efc0a937b2925612c}{%
           family={Si},
           familyi={S\bibinitperiod},
           given={Min},
           giveni={M\bibinitperiod}}}%
        {{hash=8d01d4af1462d03d8e7b4d180b0034ff}{%
           family={Singh},
           familyi={S\bibinitperiod},
           given={Mitesh\bibnamedelima Kumar},
           giveni={M\bibinitperiod\bibinitdelim K\bibinitperiod}}}%
        {{hash=92aac3ec505dd813ea2ddd0b1a3841e6}{%
           family={Hassan},
           familyi={H\bibinitperiod},
           given={Mona},
           giveni={M\bibinitperiod}}}%
        {{hash=78a420900f50a8470ad085fb05231bf6}{%
           family={Goyal},
           familyi={G\bibinitperiod},
           given={Naman},
           giveni={N\bibinitperiod}}}%
        {{hash=c5e5ae63a4f015ffa0d6a6f773f988c7}{%
           family={Torabi},
           familyi={T\bibinitperiod},
           given={Narjes},
           giveni={N\bibinitperiod}}}%
        {{hash=8dca70cf10dd8f894b4dff4af9ff238c}{%
           family={Bashlykov},
           familyi={B\bibinitperiod},
           given={Nikolay},
           giveni={N\bibinitperiod}}}%
        {{hash=d58110a310cacc94692f0f5b6dd202ed}{%
           family={Bogoychev},
           familyi={B\bibinitperiod},
           given={Nikolay},
           giveni={N\bibinitperiod}}}%
        {{hash=ef6ded1d36f3b5b10bb5f2447bc40818}{%
           family={Chatterji},
           familyi={C\bibinitperiod},
           given={Niladri},
           giveni={N\bibinitperiod}}}%
        {{hash=803fb0c7ba592ff2ac5109218a4a8211}{%
           family={Zhang},
           familyi={Z\bibinitperiod},
           given={Ning},
           giveni={N\bibinitperiod}}}%
        {{hash=f9c5d2c162690076b15de314a8215961}{%
           family={Duchenne},
           familyi={D\bibinitperiod},
           given={Olivier},
           giveni={O\bibinitperiod}}}%
        {{hash=b50226f3de19ee635922d59edd7ae7e5}{%
           family={Çelebi},
           familyi={Ç\bibinitperiod},
           given={Onur},
           giveni={O\bibinitperiod}}}%
        {{hash=798fef5b4c3e0906b43971fc37795f81}{%
           family={Alrassy},
           familyi={A\bibinitperiod},
           given={Patrick},
           giveni={P\bibinitperiod}}}%
        {{hash=6e8ae7560608b7727418a49a752bbe2f}{%
           family={Zhang},
           familyi={Z\bibinitperiod},
           given={Pengchuan},
           giveni={P\bibinitperiod}}}%
        {{hash=053d099671dbc892fb57a5464fe99862}{%
           family={Li},
           familyi={L\bibinitperiod},
           given={Pengwei},
           giveni={P\bibinitperiod}}}%
        {{hash=4e5b76c778a7d65b18700c12f33efa62}{%
           family={Vasic},
           familyi={V\bibinitperiod},
           given={Petar},
           giveni={P\bibinitperiod}}}%
        {{hash=e190d2d85cfe549644d9d4270cf3c193}{%
           family={Weng},
           familyi={W\bibinitperiod},
           given={Peter},
           giveni={P\bibinitperiod}}}%
        {{hash=f6126d401371bb053d15e54678a5d2be}{%
           family={Bhargava},
           familyi={B\bibinitperiod},
           given={Prajjwal},
           giveni={P\bibinitperiod}}}%
        {{hash=b2ca9905acb96c0dd1b36c24148fc07e}{%
           family={Dubal},
           familyi={D\bibinitperiod},
           given={Pratik},
           giveni={P\bibinitperiod}}}%
        {{hash=837a8f1fd024a33720a1ba69b40a2dc0}{%
           family={Krishnan},
           familyi={K\bibinitperiod},
           given={Praveen},
           giveni={P\bibinitperiod}}}%
        {{hash=b58bfbc914fead2ccb6bc50a44bbe36f}{%
           family={Koura},
           familyi={K\bibinitperiod},
           given={Punit\bibnamedelima Singh},
           giveni={P\bibinitperiod\bibinitdelim S\bibinitperiod}}}%
        {{hash=45be0856419ed489bdf51603a27cf854}{%
           family={Xu},
           familyi={X\bibinitperiod},
           given={Puxin},
           giveni={P\bibinitperiod}}}%
        {{hash=7c27f1b2b48feefb0593a05e9c6a8b12}{%
           family={He},
           familyi={H\bibinitperiod},
           given={Qing},
           giveni={Q\bibinitperiod}}}%
        {{hash=13993f1539efb56c308bc5396bf5b0f4}{%
           family={Dong},
           familyi={D\bibinitperiod},
           given={Qingxiao},
           giveni={Q\bibinitperiod}}}%
        {{hash=439acb42a33468f60e368e4c9b5bb4ed}{%
           family={Srinivasan},
           familyi={S\bibinitperiod},
           given={Ragavan},
           giveni={R\bibinitperiod}}}%
        {{hash=7588dba48927dee26ecc709c9167169e}{%
           family={Ganapathy},
           familyi={G\bibinitperiod},
           given={Raj},
           giveni={R\bibinitperiod}}}%
        {{hash=329dcc3352aaa5053bed2565ff100e10}{%
           family={Calderer},
           familyi={C\bibinitperiod},
           given={Ramon},
           giveni={R\bibinitperiod}}}%
        {{hash=aee7d69c56b580e9bedc7fefc9eb9c52}{%
           family={Cabral},
           familyi={C\bibinitperiod},
           given={Ricardo\bibnamedelima Silveira},
           giveni={R\bibinitperiod\bibinitdelim S\bibinitperiod}}}%
        {{hash=5f64b32e164398414aabe27f1af0140e}{%
           family={Stojnic},
           familyi={S\bibinitperiod},
           given={Robert},
           giveni={R\bibinitperiod}}}%
        {{hash=6f4fcbeef9e0ff74d528e953d5c5f6c7}{%
           family={Raileanu},
           familyi={R\bibinitperiod},
           given={Roberta},
           giveni={R\bibinitperiod}}}%
        {{hash=f62a5cd724856f655b3ec8948b158fbf}{%
           family={Maheswari},
           familyi={M\bibinitperiod},
           given={Rohan},
           giveni={R\bibinitperiod}}}%
        {{hash=b04a9f34a16019be789d119ecef9ae8b}{%
           family={Girdhar},
           familyi={G\bibinitperiod},
           given={Rohit},
           giveni={R\bibinitperiod}}}%
        {{hash=b76c0872b581774230eafe330e0f948d}{%
           family={Patel},
           familyi={P\bibinitperiod},
           given={Rohit},
           giveni={R\bibinitperiod}}}%
        {{hash=8e33aea10f45b2bc5ebe66bc7fdbcab7}{%
           family={Sauvestre},
           familyi={S\bibinitperiod},
           given={Romain},
           giveni={R\bibinitperiod}}}%
        {{hash=249caeb243804ab63be7b727ecf9f0b3}{%
           family={Polidoro},
           familyi={P\bibinitperiod},
           given={Ronnie},
           giveni={R\bibinitperiod}}}%
        {{hash=2407ed6a0925d80f5c31039222182737}{%
           family={Sumbaly},
           familyi={S\bibinitperiod},
           given={Roshan},
           giveni={R\bibinitperiod}}}%
        {{hash=bc3d70abe301dce69ed52a2854aabd09}{%
           family={Taylor},
           familyi={T\bibinitperiod},
           given={Ross},
           giveni={R\bibinitperiod}}}%
        {{hash=890ca1d1a899ca554e599fcb6e7fb479}{%
           family={Silva},
           familyi={S\bibinitperiod},
           given={Ruan},
           giveni={R\bibinitperiod}}}%
        {{hash=87e1cd3cb3c64f79a269f8eb6ca4689c}{%
           family={Hou},
           familyi={H\bibinitperiod},
           given={Rui},
           giveni={R\bibinitperiod}}}%
        {{hash=9a8e37c2db183faff113a94a5dbc4914}{%
           family={Wang},
           familyi={W\bibinitperiod},
           given={Rui},
           giveni={R\bibinitperiod}}}%
        {{hash=4abc1e75d2af9ab7d913201989a0e571}{%
           family={Hosseini},
           familyi={H\bibinitperiod},
           given={Saghar},
           giveni={S\bibinitperiod}}}%
        {{hash=01bfc925489a1aa0b42bbccd3a1b910d}{%
           family={Chennabasappa},
           familyi={C\bibinitperiod},
           given={Sahana},
           giveni={S\bibinitperiod}}}%
        {{hash=f6f98d9855931a1b4a26f28c431c896c}{%
           family={Singh},
           familyi={S\bibinitperiod},
           given={Sanjay},
           giveni={S\bibinitperiod}}}%
        {{hash=66430b8659a566bd0a6f426873ec981a}{%
           family={Bell},
           familyi={B\bibinitperiod},
           given={Sean},
           giveni={S\bibinitperiod}}}%
        {{hash=17805ef7508734c22d008d0042164d91}{%
           family={Kim},
           familyi={K\bibinitperiod},
           given={Seohyun\bibnamedelima Sonia},
           giveni={S\bibinitperiod\bibinitdelim S\bibinitperiod}}}%
        {{hash=79caf76234e835df3dc38a785e0913e0}{%
           family={Edunov},
           familyi={E\bibinitperiod},
           given={Sergey},
           giveni={S\bibinitperiod}}}%
        {{hash=0d41a9b721eb8bfd6c1060b3a974cdbe}{%
           family={Nie},
           familyi={N\bibinitperiod},
           given={Shaoliang},
           giveni={S\bibinitperiod}}}%
        {{hash=a2da348cbbad750c6fe76dda9c35ffcd}{%
           family={Narang},
           familyi={N\bibinitperiod},
           given={Sharan},
           giveni={S\bibinitperiod}}}%
        {{hash=f46bde2b73f64feac494d54df17a56cd}{%
           family={Raparthy},
           familyi={R\bibinitperiod},
           given={Sharath},
           giveni={S\bibinitperiod}}}%
        {{hash=0e8faef8660b332360bc58caaa793303}{%
           family={Shen},
           familyi={S\bibinitperiod},
           given={Sheng},
           giveni={S\bibinitperiod}}}%
        {{hash=2980de2259ff3bfd7c43b05073509045}{%
           family={Wan},
           familyi={W\bibinitperiod},
           given={Shengye},
           giveni={S\bibinitperiod}}}%
        {{hash=7681ed73d0f254dc4ce489faa0245a38}{%
           family={Bhosale},
           familyi={B\bibinitperiod},
           given={Shruti},
           giveni={S\bibinitperiod}}}%
        {{hash=a3739bbe1787246c16692bfb043543a2}{%
           family={Zhang},
           familyi={Z\bibinitperiod},
           given={Shun},
           giveni={S\bibinitperiod}}}%
        {{hash=8366514841cca3b7ed038c0422a0177f}{%
           family={Vandenhende},
           familyi={V\bibinitperiod},
           given={Simon},
           giveni={S\bibinitperiod}}}%
        {{hash=1b9611b3526fa975cb70666e43061068}{%
           family={Batra},
           familyi={B\bibinitperiod},
           given={Soumya},
           giveni={S\bibinitperiod}}}%
        {{hash=957f76287a021b9d8a0a3ad11b2b2e22}{%
           family={Whitman},
           familyi={W\bibinitperiod},
           given={Spencer},
           giveni={S\bibinitperiod}}}%
        {{hash=6bf726fdc870ddfdcb98122f0f9e7422}{%
           family={Sootla},
           familyi={S\bibinitperiod},
           given={Sten},
           giveni={S\bibinitperiod}}}%
        {{hash=4b86bc07b579ac8c2921000e01f27a80}{%
           family={Collot},
           familyi={C\bibinitperiod},
           given={Stephane},
           giveni={S\bibinitperiod}}}%
        {{hash=d1d3c4c5376249f5a5ed8c43c6585e47}{%
           family={Gururangan},
           familyi={G\bibinitperiod},
           given={Suchin},
           giveni={S\bibinitperiod}}}%
        {{hash=824d6e2c49ec949550246a2ea57a743e}{%
           family={Borodinsky},
           familyi={B\bibinitperiod},
           given={Sydney},
           giveni={S\bibinitperiod}}}%
        {{hash=b0a9bd1317ecd31e7a0bf07e018aca1e}{%
           family={Herman},
           familyi={H\bibinitperiod},
           given={Tamar},
           giveni={T\bibinitperiod}}}%
        {{hash=51f4beece23d913bedabfbe65082e9b2}{%
           family={Fowler},
           familyi={F\bibinitperiod},
           given={Tara},
           giveni={T\bibinitperiod}}}%
        {{hash=d9cd0f1b7f1372adec7ab0cf7b63a5f1}{%
           family={Sheasha},
           familyi={S\bibinitperiod},
           given={Tarek},
           giveni={T\bibinitperiod}}}%
        {{hash=55899b1834a47e42e0d2d9e15f4fa5e8}{%
           family={Georgiou},
           familyi={G\bibinitperiod},
           given={Thomas},
           giveni={T\bibinitperiod}}}%
        {{hash=3669dc61c228df3d7b95b1306107fa82}{%
           family={Scialom},
           familyi={S\bibinitperiod},
           given={Thomas},
           giveni={T\bibinitperiod}}}%
        {{hash=db801b929045385e0278353141905b77}{%
           family={Speckbacher},
           familyi={S\bibinitperiod},
           given={Tobias},
           giveni={T\bibinitperiod}}}%
        {{hash=2760810ac53a3b0afd0d63a8af2b52e3}{%
           family={Mihaylov},
           familyi={M\bibinitperiod},
           given={Todor},
           giveni={T\bibinitperiod}}}%
        {{hash=41028368e6169b6177f4b66947f5eed0}{%
           family={Xiao},
           familyi={X\bibinitperiod},
           given={Tong},
           giveni={T\bibinitperiod}}}%
        {{hash=985c4475f1e55e59f7bd68f5ac293c6b}{%
           family={Karn},
           familyi={K\bibinitperiod},
           given={Ujjwal},
           giveni={U\bibinitperiod}}}%
        {{hash=3b3711fab2634fac4eff6816c0f5cb0c}{%
           family={Goswami},
           familyi={G\bibinitperiod},
           given={Vedanuj},
           giveni={V\bibinitperiod}}}%
        {{hash=4d2a9682f134773155ee92056a02000a}{%
           family={Gupta},
           familyi={G\bibinitperiod},
           given={Vibhor},
           giveni={V\bibinitperiod}}}%
        {{hash=98b5373cace5e2cae4451d8e1ab0f2a6}{%
           family={Ramanathan},
           familyi={R\bibinitperiod},
           given={Vignesh},
           giveni={V\bibinitperiod}}}%
        {{hash=8406b239af8c6ae9ab411887b09b8cdd}{%
           family={Kerkez},
           familyi={K\bibinitperiod},
           given={Viktor},
           giveni={V\bibinitperiod}}}%
        {{hash=731e41af12131339812a2e1d2fd4264b}{%
           family={Gonguet},
           familyi={G\bibinitperiod},
           given={Vincent},
           giveni={V\bibinitperiod}}}%
        {{hash=385be234eecddfc0f46e562565e0e8d2}{%
           family={Do},
           familyi={D\bibinitperiod},
           given={Virginie},
           giveni={V\bibinitperiod}}}%
        {{hash=456bbb7e40bd87c238fd46331abc4852}{%
           family={Vogeti},
           familyi={V\bibinitperiod},
           given={Vish},
           giveni={V\bibinitperiod}}}%
        {{hash=3de5b6c6ed631b76658ed2f0a0c8c56e}{%
           family={Albiero},
           familyi={A\bibinitperiod},
           given={Vítor},
           giveni={V\bibinitperiod}}}%
        {{hash=03f1f84e19c0effe98205ab9a4d71724}{%
           family={Petrovic},
           familyi={P\bibinitperiod},
           given={Vladan},
           giveni={V\bibinitperiod}}}%
        {{hash=ae16043bc735d2e68fd2f2048a261cb0}{%
           family={Chu},
           familyi={C\bibinitperiod},
           given={Weiwei},
           giveni={W\bibinitperiod}}}%
        {{hash=ebf728d4edd3772aa46233df8265003e}{%
           family={Xiong},
           familyi={X\bibinitperiod},
           given={Wenhan},
           giveni={W\bibinitperiod}}}%
        {{hash=c206969fdfb0e87b34f30ee6cc0f0139}{%
           family={Fu},
           familyi={F\bibinitperiod},
           given={Wenyin},
           giveni={W\bibinitperiod}}}%
        {{hash=0dca8ecf486ac7cf75fdac6bef569a8b}{%
           family={Meers},
           familyi={M\bibinitperiod},
           given={Whitney},
           giveni={W\bibinitperiod}}}%
        {{hash=7222f9d76b0fff504f39e7c9c2a526be}{%
           family={Martinet},
           familyi={M\bibinitperiod},
           given={Xavier},
           giveni={X\bibinitperiod}}}%
        {{hash=cd26424dac955ebe267f1a2f0325d9f3}{%
           family={Wang},
           familyi={W\bibinitperiod},
           given={Xiaodong},
           giveni={X\bibinitperiod}}}%
        {{hash=e36ef4c933b18c6fa38007e1c522dde6}{%
           family={Wang},
           familyi={W\bibinitperiod},
           given={Xiaofang},
           giveni={X\bibinitperiod}}}%
        {{hash=9cf8d901d24d77adab28b880dc77fbde}{%
           family={Tan},
           familyi={T\bibinitperiod},
           given={Xiaoqing\bibnamedelima Ellen},
           giveni={X\bibinitperiod\bibinitdelim E\bibinitperiod}}}%
        {{hash=317b463e486d5ad69936294c6db717ff}{%
           family={Xia},
           familyi={X\bibinitperiod},
           given={Xide},
           giveni={X\bibinitperiod}}}%
        {{hash=171702d62eddf18f37fcdb07dd3cc38f}{%
           family={Xie},
           familyi={X\bibinitperiod},
           given={Xinfeng},
           giveni={X\bibinitperiod}}}%
        {{hash=7778cc0a3ceb7bc7d21da689ccbacadd}{%
           family={Jia},
           familyi={J\bibinitperiod},
           given={Xuchao},
           giveni={X\bibinitperiod}}}%
        {{hash=aca8c393efd61cde9155d6edae887bcc}{%
           family={Wang},
           familyi={W\bibinitperiod},
           given={Xuewei},
           giveni={X\bibinitperiod}}}%
        {{hash=fdb54ac249abf18859648480c419bf0f}{%
           family={Goldschlag},
           familyi={G\bibinitperiod},
           given={Yaelle},
           giveni={Y\bibinitperiod}}}%
        {{hash=d0815b5d48e41b65855ec469e3546971}{%
           family={Gaur},
           familyi={G\bibinitperiod},
           given={Yashesh},
           giveni={Y\bibinitperiod}}}%
        {{hash=3f8d04c034a513f6abe1e2c15f14e3e4}{%
           family={Babaei},
           familyi={B\bibinitperiod},
           given={Yasmine},
           giveni={Y\bibinitperiod}}}%
        {{hash=a64d15774d6fc7b1171ced403cea68c3}{%
           family={Wen},
           familyi={W\bibinitperiod},
           given={Yi},
           giveni={Y\bibinitperiod}}}%
        {{hash=9bd32de2762a7622190cdc86304f6b18}{%
           family={Song},
           familyi={S\bibinitperiod},
           given={Yiwen},
           giveni={Y\bibinitperiod}}}%
        {{hash=584fe8cb46f9a24597f46045f82d1d8d}{%
           family={Zhang},
           familyi={Z\bibinitperiod},
           given={Yuchen},
           giveni={Y\bibinitperiod}}}%
        {{hash=0e1dff109644a2423d611a0bfe123178}{%
           family={Li},
           familyi={L\bibinitperiod},
           given={Yue},
           giveni={Y\bibinitperiod}}}%
        {{hash=4bf12306f229966567f3fa80a61f52c9}{%
           family={Mao},
           familyi={M\bibinitperiod},
           given={Yuning},
           giveni={Y\bibinitperiod}}}%
        {{hash=5d127fc68c862ac6acbaf194dd5341b3}{%
           family={Coudert},
           familyi={C\bibinitperiod},
           given={Zacharie\bibnamedelima Delpierre},
           giveni={Z\bibinitperiod\bibinitdelim D\bibinitperiod}}}%
        {{hash=d2ade1cc491ab061c743877b9fac6eb4}{%
           family={Yan},
           familyi={Y\bibinitperiod},
           given={Zheng},
           giveni={Z\bibinitperiod}}}%
        {{hash=c2e101fe9820cc9ebb5a6d51ebdff69f}{%
           family={Chen},
           familyi={C\bibinitperiod},
           given={Zhengxing},
           giveni={Z\bibinitperiod}}}%
        {{hash=924298ff0f42916eefd4612747b69168}{%
           family={Papakipos},
           familyi={P\bibinitperiod},
           given={Zoe},
           giveni={Z\bibinitperiod}}}%
        {{hash=3f3a905d16e64c5f11efab25a0da6255}{%
           family={Singh},
           familyi={S\bibinitperiod},
           given={Aaditya},
           giveni={A\bibinitperiod}}}%
        {{hash=d6b12b852f546c335b59d4a6703198b2}{%
           family={Srivastava},
           familyi={S\bibinitperiod},
           given={Aayushi},
           giveni={A\bibinitperiod}}}%
        {{hash=0dd18c09e0af266292d5a7e9a2accff3}{%
           family={Jain},
           familyi={J\bibinitperiod},
           given={Abha},
           giveni={A\bibinitperiod}}}%
        {{hash=c56eec940be89868eed50f123204dec0}{%
           family={Kelsey},
           familyi={K\bibinitperiod},
           given={Adam},
           giveni={A\bibinitperiod}}}%
        {{hash=dde1a2384f95b935aa2b55975ed2b3f6}{%
           family={Shajnfeld},
           familyi={S\bibinitperiod},
           given={Adam},
           giveni={A\bibinitperiod}}}%
        {{hash=4b7ae8b3b746745e1d3cadafc45ffb3e}{%
           family={Gangidi},
           familyi={G\bibinitperiod},
           given={Adithya},
           giveni={A\bibinitperiod}}}%
        {{hash=1aa5a110a6957624dd943b795f0af71d}{%
           family={Victoria},
           familyi={V\bibinitperiod},
           given={Adolfo},
           giveni={A\bibinitperiod}}}%
        {{hash=7b4fa10f252f1324eda28c7c5b71efda}{%
           family={Goldstand},
           familyi={G\bibinitperiod},
           given={Ahuva},
           giveni={A\bibinitperiod}}}%
        {{hash=70c4067ccb121ce9d1346cfc7c622279}{%
           family={Menon},
           familyi={M\bibinitperiod},
           given={Ajay},
           giveni={A\bibinitperiod}}}%
        {{hash=e9a4763f65102abab18661133f199010}{%
           family={Sharma},
           familyi={S\bibinitperiod},
           given={Ajay},
           giveni={A\bibinitperiod}}}%
        {{hash=a1f74b7b2d93ac9f180664f3ce1176f6}{%
           family={Boesenberg},
           familyi={B\bibinitperiod},
           given={Alex},
           giveni={A\bibinitperiod}}}%
        {{hash=e478046d4abc39e9814f6e364a736511}{%
           family={Baevski},
           familyi={B\bibinitperiod},
           given={Alexei},
           giveni={A\bibinitperiod}}}%
        {{hash=2e4283faf5715d7621de875320480ded}{%
           family={Feinstein},
           familyi={F\bibinitperiod},
           given={Allie},
           giveni={A\bibinitperiod}}}%
        {{hash=d5cd1376c5170b4a2fa1a09ab2d87a95}{%
           family={Kallet},
           familyi={K\bibinitperiod},
           given={Amanda},
           giveni={A\bibinitperiod}}}%
        {{hash=e9cb262adced7bca6f31d1a1294f0604}{%
           family={Sangani},
           familyi={S\bibinitperiod},
           given={Amit},
           giveni={A\bibinitperiod}}}%
        {{hash=5932d5805784c34e816d0f443040d7eb}{%
           family={Teo},
           familyi={T\bibinitperiod},
           given={Amos},
           giveni={A\bibinitperiod}}}%
        {{hash=be0e999808d5e6dd7d4c77fa1e019a35}{%
           family={Yunus},
           familyi={Y\bibinitperiod},
           given={Anam},
           giveni={A\bibinitperiod}}}%
        {{hash=89b81451635166fcb37197f8034c95d9}{%
           family={Lupu},
           familyi={L\bibinitperiod},
           given={Andrei},
           giveni={A\bibinitperiod}}}%
        {{hash=d28f306dab0a156ae0ad889a94bef7bb}{%
           family={Alvarado},
           familyi={A\bibinitperiod},
           given={Andres},
           giveni={A\bibinitperiod}}}%
        {{hash=a452e7dc78896bd8aea0ce8cbcde161e}{%
           family={Caples},
           familyi={C\bibinitperiod},
           given={Andrew},
           giveni={A\bibinitperiod}}}%
        {{hash=98cfba14708bcf56744f90225338572e}{%
           family={Gu},
           familyi={G\bibinitperiod},
           given={Andrew},
           giveni={A\bibinitperiod}}}%
        {{hash=bb8cc10f8a196a031445b79268e837ba}{%
           family={Ho},
           familyi={H\bibinitperiod},
           given={Andrew},
           giveni={A\bibinitperiod}}}%
        {{hash=a2080b9d7f5596d56ff1c48c3b0bf6aa}{%
           family={Poulton},
           familyi={P\bibinitperiod},
           given={Andrew},
           giveni={A\bibinitperiod}}}%
        {{hash=f2c437270d4e2db1f791420ed8ac551a}{%
           family={Ryan},
           familyi={R\bibinitperiod},
           given={Andrew},
           giveni={A\bibinitperiod}}}%
        {{hash=39cbdced681e69a4d9c47277f4042810}{%
           family={Ramchandani},
           familyi={R\bibinitperiod},
           given={Ankit},
           giveni={A\bibinitperiod}}}%
        {{hash=4d9ca4e485dc44ccb2cb1513d6a82cca}{%
           family={Dong},
           familyi={D\bibinitperiod},
           given={Annie},
           giveni={A\bibinitperiod}}}%
        {{hash=7db8b1027b55d4c2c8dc5778a254cd8b}{%
           family={Franco},
           familyi={F\bibinitperiod},
           given={Annie},
           giveni={A\bibinitperiod}}}%
        {{hash=a1c6baccad2cf73a63a17d4675dd2092}{%
           family={Goyal},
           familyi={G\bibinitperiod},
           given={Anuj},
           giveni={A\bibinitperiod}}}%
        {{hash=331939d1aad3f3e466c0eb41b1739e48}{%
           family={Saraf},
           familyi={S\bibinitperiod},
           given={Aparajita},
           giveni={A\bibinitperiod}}}%
        {{hash=4401d7038ab283d97db93f8c106d8087}{%
           family={Chowdhury},
           familyi={C\bibinitperiod},
           given={Arkabandhu},
           giveni={A\bibinitperiod}}}%
        {{hash=eb8a956fa9100c20675c2ee391fc7690}{%
           family={Gabriel},
           familyi={G\bibinitperiod},
           given={Ashley},
           giveni={A\bibinitperiod}}}%
        {{hash=3f6a694e9a7267ec68effb5fdaf12c1c}{%
           family={Bharambe},
           familyi={B\bibinitperiod},
           given={Ashwin},
           giveni={A\bibinitperiod}}}%
        {{hash=7340ee2f132a35281d3204fd988c70fe}{%
           family={Eisenman},
           familyi={E\bibinitperiod},
           given={Assaf},
           giveni={A\bibinitperiod}}}%
        {{hash=1b5c67fc4afdd85c2436b2d9d3f942b7}{%
           family={Yazdan},
           familyi={Y\bibinitperiod},
           given={Azadeh},
           giveni={A\bibinitperiod}}}%
        {{hash=6254b751ef20420ced84e035f2ed2139}{%
           family={James},
           familyi={J\bibinitperiod},
           given={Beau},
           giveni={B\bibinitperiod}}}%
        {{hash=dbf8ae26b403ade00095d259a53cc2c8}{%
           family={Maurer},
           familyi={M\bibinitperiod},
           given={Ben},
           giveni={B\bibinitperiod}}}%
        {{hash=afa7e051f634e451742bd0b2a88f4d59}{%
           family={Leonhardi},
           familyi={L\bibinitperiod},
           given={Benjamin},
           giveni={B\bibinitperiod}}}%
        {{hash=c219c269757ff4df4a753b12299956cb}{%
           family={Huang},
           familyi={H\bibinitperiod},
           given={Bernie},
           giveni={B\bibinitperiod}}}%
        {{hash=3aef1d7739808a2eac496e70b92c58b9}{%
           family={Loyd},
           familyi={L\bibinitperiod},
           given={Beth},
           giveni={B\bibinitperiod}}}%
        {{hash=9266fea639391d2bbeb3a046b64218c8}{%
           family={Paola},
           familyi={P\bibinitperiod},
           given={Beto\bibnamedelima De},
           giveni={B\bibinitperiod\bibinitdelim D\bibinitperiod}}}%
        {{hash=d8e8976ad7ec5848c2f5557280aa5cdf}{%
           family={Paranjape},
           familyi={P\bibinitperiod},
           given={Bhargavi},
           giveni={B\bibinitperiod}}}%
        {{hash=9c6fb2af2964f3126cfd4e505a38daca}{%
           family={Liu},
           familyi={L\bibinitperiod},
           given={Bing},
           giveni={B\bibinitperiod}}}%
        {{hash=a3467545efc97f24be8a5d66e4c70ab4}{%
           family={Wu},
           familyi={W\bibinitperiod},
           given={Bo},
           giveni={B\bibinitperiod}}}%
        {{hash=2f60b1b93fe3c1ea1a5dfcf2cec5dec1}{%
           family={Ni},
           familyi={N\bibinitperiod},
           given={Boyu},
           giveni={B\bibinitperiod}}}%
        {{hash=f003085c93285865f04f94323f8e1f55}{%
           family={Hancock},
           familyi={H\bibinitperiod},
           given={Braden},
           giveni={B\bibinitperiod}}}%
        {{hash=a486bf67c8cfeb78e434e64aa3e7de20}{%
           family={Wasti},
           familyi={W\bibinitperiod},
           given={Bram},
           giveni={B\bibinitperiod}}}%
        {{hash=83052ea7cb96114307dd409b3e563e95}{%
           family={Spence},
           familyi={S\bibinitperiod},
           given={Brandon},
           giveni={B\bibinitperiod}}}%
        {{hash=1662eb5e488536c1f5363556c2bf503d}{%
           family={Stojkovic},
           familyi={S\bibinitperiod},
           given={Brani},
           giveni={B\bibinitperiod}}}%
        {{hash=cb296ca2c75dca6391edb314d6943e54}{%
           family={Gamido},
           familyi={G\bibinitperiod},
           given={Brian},
           giveni={B\bibinitperiod}}}%
        {{hash=7b9c61ccfd8b3b9aa97317d0891e295c}{%
           family={Montalvo},
           familyi={M\bibinitperiod},
           given={Britt},
           giveni={B\bibinitperiod}}}%
        {{hash=09b953d7bf65fc43bb2742ffb96979ed}{%
           family={Parker},
           familyi={P\bibinitperiod},
           given={Carl},
           giveni={C\bibinitperiod}}}%
        {{hash=6547ed8bd56811accdf46e83b2f310ff}{%
           family={Burton},
           familyi={B\bibinitperiod},
           given={Carly},
           giveni={C\bibinitperiod}}}%
        {{hash=e5caf4b91e54513114f4b2e9d004e792}{%
           family={Mejia},
           familyi={M\bibinitperiod},
           given={Catalina},
           giveni={C\bibinitperiod}}}%
        {{hash=17bf470b120f24c48675bbcb261cab37}{%
           family={Liu},
           familyi={L\bibinitperiod},
           given={Ce},
           giveni={C\bibinitperiod}}}%
        {{hash=2242e23b82996e29a58069cd958eaca7}{%
           family={Wang},
           familyi={W\bibinitperiod},
           given={Changhan},
           giveni={C\bibinitperiod}}}%
        {{hash=2a1aad94984767bead4473eb7fd34080}{%
           family={Kim},
           familyi={K\bibinitperiod},
           given={Changkyu},
           giveni={C\bibinitperiod}}}%
        {{hash=a82f7b211fe415c0eccfd31925edc866}{%
           family={Zhou},
           familyi={Z\bibinitperiod},
           given={Chao},
           giveni={C\bibinitperiod}}}%
        {{hash=b03cef620e9fd30846f3540e0c09870f}{%
           family={Hu},
           familyi={H\bibinitperiod},
           given={Chester},
           giveni={C\bibinitperiod}}}%
        {{hash=2ccc00af77367adad3939db00bea965f}{%
           family={Chu},
           familyi={C\bibinitperiod},
           given={Ching-Hsiang},
           giveni={C\bibinithyphendelim H\bibinitperiod}}}%
        {{hash=7b2e6a6b72466725c4366d7c38b4fc04}{%
           family={Cai},
           familyi={C\bibinitperiod},
           given={Chris},
           giveni={C\bibinitperiod}}}%
        {{hash=1181defc635c4d87648d74557914379f}{%
           family={Tindal},
           familyi={T\bibinitperiod},
           given={Chris},
           giveni={C\bibinitperiod}}}%
        {{hash=bd2fff33d3a5433188d2662695e79eb5}{%
           family={Feichtenhofer},
           familyi={F\bibinitperiod},
           given={Christoph},
           giveni={C\bibinitperiod}}}%
        {{hash=8ba5b0a41692cd620325c1fc0a9dc84a}{%
           family={Gao},
           familyi={G\bibinitperiod},
           given={Cynthia},
           giveni={C\bibinitperiod}}}%
        {{hash=8ca7956e6e672d37fb851f87283db254}{%
           family={Civin},
           familyi={C\bibinitperiod},
           given={Damon},
           giveni={D\bibinitperiod}}}%
        {{hash=058b5e7e33c66f97e4c7390ae4f31c77}{%
           family={Beaty},
           familyi={B\bibinitperiod},
           given={Dana},
           giveni={D\bibinitperiod}}}%
        {{hash=df2d84aa0d9f71306f386f2e0ba4a56e}{%
           family={Kreymer},
           familyi={K\bibinitperiod},
           given={Daniel},
           giveni={D\bibinitperiod}}}%
        {{hash=4ef9f067fa7dd881ebe6076d3c1d1c5f}{%
           family={Li},
           familyi={L\bibinitperiod},
           given={Daniel},
           giveni={D\bibinitperiod}}}%
        {{hash=6ac810290b1640b6062b03b865aa3f26}{%
           family={Adkins},
           familyi={A\bibinitperiod},
           given={David},
           giveni={D\bibinitperiod}}}%
        {{hash=4ab4bfa54620bfb6e3beb068ed5d87c7}{%
           family={Xu},
           familyi={X\bibinitperiod},
           given={David},
           giveni={D\bibinitperiod}}}%
        {{hash=b8388eead45ea4429fa88916bc9a6cd5}{%
           family={Testuggine},
           familyi={T\bibinitperiod},
           given={Davide},
           giveni={D\bibinitperiod}}}%
        {{hash=d0243a1eeb11d9a28d68e4837a3f219d}{%
           family={David},
           familyi={D\bibinitperiod},
           given={Delia},
           giveni={D\bibinitperiod}}}%
        {{hash=d0ab7a4601951a0c59352f1dcb531afb}{%
           family={Parikh},
           familyi={P\bibinitperiod},
           given={Devi},
           giveni={D\bibinitperiod}}}%
        {{hash=727001a7f22db6717a536a1042b6f98b}{%
           family={Liskovich},
           familyi={L\bibinitperiod},
           given={Diana},
           giveni={D\bibinitperiod}}}%
        {{hash=aee34486f0fd233b49c203b3d130f41e}{%
           family={Foss},
           familyi={F\bibinitperiod},
           given={Didem},
           giveni={D\bibinitperiod}}}%
        {{hash=6febfd7fda62e1c77a555b50c9af4748}{%
           family={Wang},
           familyi={W\bibinitperiod},
           given={Dingkang},
           giveni={D\bibinitperiod}}}%
        {{hash=8c94a3f45f138176d92596819219883c}{%
           family={Le},
           familyi={L\bibinitperiod},
           given={Duc},
           giveni={D\bibinitperiod}}}%
        {{hash=bc5feac31f8fc7de99343e7e1aa94b59}{%
           family={Holland},
           familyi={H\bibinitperiod},
           given={Dustin},
           giveni={D\bibinitperiod}}}%
        {{hash=29f7b97ba50d0cbdb026f2c915c20d41}{%
           family={Dowling},
           familyi={D\bibinitperiod},
           given={Edward},
           giveni={E\bibinitperiod}}}%
        {{hash=daa6288a29af11a3a945b3c6570e923c}{%
           family={Jamil},
           familyi={J\bibinitperiod},
           given={Eissa},
           giveni={E\bibinitperiod}}}%
        {{hash=174e31a1aa41b374bb067963b6d2a13b}{%
           family={Montgomery},
           familyi={M\bibinitperiod},
           given={Elaine},
           giveni={E\bibinitperiod}}}%
        {{hash=360e2ddb867a61eb479ae7d054745568}{%
           family={Presani},
           familyi={P\bibinitperiod},
           given={Eleonora},
           giveni={E\bibinitperiod}}}%
        {{hash=ae9b4e3637efc7f1be303e3a65679b65}{%
           family={Hahn},
           familyi={H\bibinitperiod},
           given={Emily},
           giveni={E\bibinitperiod}}}%
        {{hash=a3f5964b64c780013113e6c7ec9fd077}{%
           family={Wood},
           familyi={W\bibinitperiod},
           given={Emily},
           giveni={E\bibinitperiod}}}%
        {{hash=93fc269f0dd4a6f7aa03bd0ec36e72bf}{%
           family={Le},
           familyi={L\bibinitperiod},
           given={Eric-Tuan},
           giveni={E\bibinithyphendelim T\bibinitperiod}}}%
        {{hash=1720f8a37adce15a8477dcca02991c42}{%
           family={Brinkman},
           familyi={B\bibinitperiod},
           given={Erik},
           giveni={E\bibinitperiod}}}%
        {{hash=2201729bd61693bd36df860408450550}{%
           family={Arcaute},
           familyi={A\bibinitperiod},
           given={Esteban},
           giveni={E\bibinitperiod}}}%
        {{hash=51c48faf493d65df58dd924e74339197}{%
           family={Dunbar},
           familyi={D\bibinitperiod},
           given={Evan},
           giveni={E\bibinitperiod}}}%
        {{hash=12ce8810094604a466f2b16a711b350d}{%
           family={Smothers},
           familyi={S\bibinitperiod},
           given={Evan},
           giveni={E\bibinitperiod}}}%
        {{hash=0fff2d014f575fc5d680e70e02e8ce38}{%
           family={Sun},
           familyi={S\bibinitperiod},
           given={Fei},
           giveni={F\bibinitperiod}}}%
        {{hash=7b9f656a709e39ab921a2319da205e6b}{%
           family={Kreuk},
           familyi={K\bibinitperiod},
           given={Felix},
           giveni={F\bibinitperiod}}}%
        {{hash=1487e60477fb6a315fa69b2f8ee53c9f}{%
           family={Tian},
           familyi={T\bibinitperiod},
           given={Feng},
           giveni={F\bibinitperiod}}}%
        {{hash=d3dbc65779f0402cc427ae4798da5271}{%
           family={Kokkinos},
           familyi={K\bibinitperiod},
           given={Filippos},
           giveni={F\bibinitperiod}}}%
        {{hash=b99972de6b245e2104b4eacd84a61fc6}{%
           family={Ozgenel},
           familyi={O\bibinitperiod},
           given={Firat},
           giveni={F\bibinitperiod}}}%
        {{hash=d4eb4c0bac6f1261470c119f71c81bb8}{%
           family={Caggioni},
           familyi={C\bibinitperiod},
           given={Francesco},
           giveni={F\bibinitperiod}}}%
        {{hash=f736a2cbfb475ab66e4513656b1e5cc4}{%
           family={Kanayet},
           familyi={K\bibinitperiod},
           given={Frank},
           giveni={F\bibinitperiod}}}%
        {{hash=ef03c6cf9b4db1e1c72b2202a2b4ab62}{%
           family={Seide},
           familyi={S\bibinitperiod},
           given={Frank},
           giveni={F\bibinitperiod}}}%
        {{hash=3f0a19d35feafb9f65696b5dc34cac51}{%
           family={Florez},
           familyi={F\bibinitperiod},
           given={Gabriela\bibnamedelima Medina},
           giveni={G\bibinitperiod\bibinitdelim M\bibinitperiod}}}%
        {{hash=384b4168a5627486c8f2863f21193b39}{%
           family={Schwarz},
           familyi={S\bibinitperiod},
           given={Gabriella},
           giveni={G\bibinitperiod}}}%
        {{hash=c586335e51a7a87f4ef46cba95d55596}{%
           family={Badeer},
           familyi={B\bibinitperiod},
           given={Gada},
           giveni={G\bibinitperiod}}}%
        {{hash=2adac47a7bc3aafff7340267307f70b4}{%
           family={Swee},
           familyi={S\bibinitperiod},
           given={Georgia},
           giveni={G\bibinitperiod}}}%
        {{hash=89b56db5c795155a6fb477702b8d5581}{%
           family={Halpern},
           familyi={H\bibinitperiod},
           given={Gil},
           giveni={G\bibinitperiod}}}%
        {{hash=37ec7fa8deaf3d2beea69784038208a0}{%
           family={Herman},
           familyi={H\bibinitperiod},
           given={Grant},
           giveni={G\bibinitperiod}}}%
        {{hash=12156b26e288b160b4084dd01f5f2433}{%
           family={Sizov},
           familyi={S\bibinitperiod},
           given={Grigory},
           giveni={G\bibinitperiod}}}%
        {{hash=9d418d200efef33c32bc46e8dc4a9359}{%
           family={Guangyi},
           familyi={G\bibinitperiod}}}%
        {{hash=96641e4a5a09e69b32236adbdfd55407}{%
           family={Zhang},
           familyi={Z\bibinitperiod}}}%
        {{hash=14ad5c11fc07d52d855b3fab9364e3b2}{%
           family={Lakshminarayanan},
           familyi={L\bibinitperiod},
           given={Guna},
           giveni={G\bibinitperiod}}}%
        {{hash=3bf2bb5e273c329482dd632f9a6aaead}{%
           family={Inan},
           familyi={I\bibinitperiod},
           given={Hakan},
           giveni={H\bibinitperiod}}}%
        {{hash=1edddb2944fb62f8da41fffb45d5aa81}{%
           family={Shojanazeri},
           familyi={S\bibinitperiod},
           given={Hamid},
           giveni={H\bibinitperiod}}}%
        {{hash=b6770a40a9ff8665ab0cd2e6541f3240}{%
           family={Zou},
           familyi={Z\bibinitperiod},
           given={Han},
           giveni={H\bibinitperiod}}}%
        {{hash=40449267be2ba6897871104bc8331651}{%
           family={Wang},
           familyi={W\bibinitperiod},
           given={Hannah},
           giveni={H\bibinitperiod}}}%
        {{hash=9dfe209df23e6d03983a09530a82cb3d}{%
           family={Zha},
           familyi={Z\bibinitperiod},
           given={Hanwen},
           giveni={H\bibinitperiod}}}%
        {{hash=0c672199b1759a017363c25814efa131}{%
           family={Habeeb},
           familyi={H\bibinitperiod},
           given={Haroun},
           giveni={H\bibinitperiod}}}%
        {{hash=7b715ce32bdd298a7fb03f43611662af}{%
           family={Rudolph},
           familyi={R\bibinitperiod},
           given={Harrison},
           giveni={H\bibinitperiod}}}%
        {{hash=8bf7efa7375ec8441db1315cb6341021}{%
           family={Suk},
           familyi={S\bibinitperiod},
           given={Helen},
           giveni={H\bibinitperiod}}}%
        {{hash=22864511e9484bbaa1d6813336431ad9}{%
           family={Aspegren},
           familyi={A\bibinitperiod},
           given={Henry},
           giveni={H\bibinitperiod}}}%
        {{hash=689667fa714c2b602d05f3914d3a0725}{%
           family={Goldman},
           familyi={G\bibinitperiod},
           given={Hunter},
           giveni={H\bibinitperiod}}}%
        {{hash=b10b9b2738fd3d8d5f840065b0e0b73c}{%
           family={Zhan},
           familyi={Z\bibinitperiod},
           given={Hongyuan},
           giveni={H\bibinitperiod}}}%
        {{hash=42cdcc3f8e787e24f00227ace3ae337f}{%
           family={Damlaj},
           familyi={D\bibinitperiod},
           given={Ibrahim},
           giveni={I\bibinitperiod}}}%
        {{hash=9c9c8b449afb88c0a84739775b9c805a}{%
           family={Molybog},
           familyi={M\bibinitperiod},
           given={Igor},
           giveni={I\bibinitperiod}}}%
        {{hash=4fd0bfb5a490ac411200ecb4bfef3f11}{%
           family={Tufanov},
           familyi={T\bibinitperiod},
           given={Igor},
           giveni={I\bibinitperiod}}}%
        {{hash=b8cd35e34bfc5c9a7b270d6e7971d881}{%
           family={Leontiadis},
           familyi={L\bibinitperiod},
           given={Ilias},
           giveni={I\bibinitperiod}}}%
        {{hash=216c5d5b0ac00adf927eb88fade8f732}{%
           family={Veliche},
           familyi={V\bibinitperiod},
           given={Irina-Elena},
           giveni={I\bibinithyphendelim E\bibinitperiod}}}%
        {{hash=392591856940aee2897c65ba822d427b}{%
           family={Gat},
           familyi={G\bibinitperiod},
           given={Itai},
           giveni={I\bibinitperiod}}}%
        {{hash=bc66e3b1f664316b58e0fa7e96908782}{%
           family={Weissman},
           familyi={W\bibinitperiod},
           given={Jake},
           giveni={J\bibinitperiod}}}%
        {{hash=69e04724121064e19d266a9d52e93e1d}{%
           family={Geboski},
           familyi={G\bibinitperiod},
           given={James},
           giveni={J\bibinitperiod}}}%
        {{hash=3f17b4f956cd65800dd6498530521e36}{%
           family={Kohli},
           familyi={K\bibinitperiod},
           given={James},
           giveni={J\bibinitperiod}}}%
        {{hash=45b2043caa8c5a5b93538567756cb862}{%
           family={Lam},
           familyi={L\bibinitperiod},
           given={Janice},
           giveni={J\bibinitperiod}}}%
        {{hash=1c77614dbf40c86333a72fc8eceec34c}{%
           family={Asher},
           familyi={A\bibinitperiod},
           given={Japhet},
           giveni={J\bibinitperiod}}}%
        {{hash=dc250b018c408a1cc08c34e8a260090f}{%
           family={Gaya},
           familyi={G\bibinitperiod},
           given={Jean-Baptiste},
           giveni={J\bibinithyphendelim B\bibinitperiod}}}%
        {{hash=c341c5e189b2025238f2f39bb76b4947}{%
           family={Marcus},
           familyi={M\bibinitperiod},
           given={Jeff},
           giveni={J\bibinitperiod}}}%
        {{hash=cc3a414791478f4727d40c3ad7d09cd7}{%
           family={Tang},
           familyi={T\bibinitperiod},
           given={Jeff},
           giveni={J\bibinitperiod}}}%
        {{hash=d6d87955aa9f1e36aae0beb2c514bbbd}{%
           family={Chan},
           familyi={C\bibinitperiod},
           given={Jennifer},
           giveni={J\bibinitperiod}}}%
        {{hash=d2f41415278d8616e4711c471ab1873b}{%
           family={Zhen},
           familyi={Z\bibinitperiod},
           given={Jenny},
           giveni={J\bibinitperiod}}}%
        {{hash=8ba0e40bb2bd52546beafceb6b00d636}{%
           family={Reizenstein},
           familyi={R\bibinitperiod},
           given={Jeremy},
           giveni={J\bibinitperiod}}}%
        {{hash=26943fe4d27376d4354dd33390b14704}{%
           family={Teboul},
           familyi={T\bibinitperiod},
           given={Jeremy},
           giveni={J\bibinitperiod}}}%
        {{hash=a3c07cfb8f07a8a6e8f6a1eb59f2f6d6}{%
           family={Zhong},
           familyi={Z\bibinitperiod},
           given={Jessica},
           giveni={J\bibinitperiod}}}%
        {{hash=bb687b4404472c334bebf0bb6522d834}{%
           family={Jin},
           familyi={J\bibinitperiod},
           given={Jian},
           giveni={J\bibinitperiod}}}%
        {{hash=ed829830567c4c5d7f41d8a5c6871390}{%
           family={Yang},
           familyi={Y\bibinitperiod},
           given={Jingyi},
           giveni={J\bibinitperiod}}}%
        {{hash=8dbf9143627729104a6d6b0cfd7bf8bc}{%
           family={Cummings},
           familyi={C\bibinitperiod},
           given={Joe},
           giveni={J\bibinitperiod}}}%
        {{hash=c8a27f8b9e1b59daf8236999e928d9c8}{%
           family={Carvill},
           familyi={C\bibinitperiod},
           given={Jon},
           giveni={J\bibinitperiod}}}%
        {{hash=5c11475174c12ffc16f7741655c40161}{%
           family={Shepard},
           familyi={S\bibinitperiod},
           given={Jon},
           giveni={J\bibinitperiod}}}%
        {{hash=469d06adc4af09b08e9fa105b53879c8}{%
           family={McPhie},
           familyi={M\bibinitperiod},
           given={Jonathan},
           giveni={J\bibinitperiod}}}%
        {{hash=d1bf80616f29a28b111b65ce463503d1}{%
           family={Torres},
           familyi={T\bibinitperiod},
           given={Jonathan},
           giveni={J\bibinitperiod}}}%
        {{hash=25071ce9679f53750a15cfd7417fb8ca}{%
           family={Ginsburg},
           familyi={G\bibinitperiod},
           given={Josh},
           giveni={J\bibinitperiod}}}%
        {{hash=0311431642470a7b59cea4fbf9543da7}{%
           family={Wang},
           familyi={W\bibinitperiod},
           given={Junjie},
           giveni={J\bibinitperiod}}}%
        {{hash=6925c5dcdb9b5ed8f2a02432404549e7}{%
           family={Wu},
           familyi={W\bibinitperiod},
           given={Kai},
           giveni={K\bibinitperiod}}}%
        {{hash=754fb4fa1236164d9640c2837ad08976}{%
           family={U},
           familyi={U\bibinitperiod},
           given={Kam\bibnamedelima Hou},
           giveni={K\bibinitperiod\bibinitdelim H\bibinitperiod}}}%
        {{hash=411c62e43d66e155f8f0d60695dd8181}{%
           family={Saxena},
           familyi={S\bibinitperiod},
           given={Karan},
           giveni={K\bibinitperiod}}}%
        {{hash=9e9a1e2c7a348addec1212ed39541436}{%
           family={Khandelwal},
           familyi={K\bibinitperiod},
           given={Kartikay},
           giveni={K\bibinitperiod}}}%
        {{hash=c9d508e3ff06c17ab652a9e7abf1e68a}{%
           family={Zand},
           familyi={Z\bibinitperiod},
           given={Katayoun},
           giveni={K\bibinitperiod}}}%
        {{hash=8b140dcb364c626357a8fb98a018ebb5}{%
           family={Matosich},
           familyi={M\bibinitperiod},
           given={Kathy},
           giveni={K\bibinitperiod}}}%
        {{hash=f2c1fa48fb8bfe45a582cdb42d0f3d96}{%
           family={Veeraraghavan},
           familyi={V\bibinitperiod},
           given={Kaushik},
           giveni={K\bibinitperiod}}}%
        {{hash=741b4ea99ca87a9a2a08a4132c10ded8}{%
           family={Michelena},
           familyi={M\bibinitperiod},
           given={Kelly},
           giveni={K\bibinitperiod}}}%
        {{hash=e242ebe4f32fe5bd2dc39b67705e1c4e}{%
           family={Li},
           familyi={L\bibinitperiod},
           given={Keqian},
           giveni={K\bibinitperiod}}}%
        {{hash=c7b359c7b9b22622f87d0d4235ef725e}{%
           family={Jagadeesh},
           familyi={J\bibinitperiod},
           given={Kiran},
           giveni={K\bibinitperiod}}}%
        {{hash=d00246b1153ed058a9db188c365474ca}{%
           family={Huang},
           familyi={H\bibinitperiod},
           given={Kun},
           giveni={K\bibinitperiod}}}%
        {{hash=40599c412a1ddc8b236d536512792328}{%
           family={Chawla},
           familyi={C\bibinitperiod},
           given={Kunal},
           giveni={K\bibinitperiod}}}%
        {{hash=e17f32f060d0e2a15d317d2984d0ab35}{%
           family={Huang},
           familyi={H\bibinitperiod},
           given={Kyle},
           giveni={K\bibinitperiod}}}%
        {{hash=95c5a4f8b36337cc8d62b2d2a3f49e1f}{%
           family={Chen},
           familyi={C\bibinitperiod},
           given={Lailin},
           giveni={L\bibinitperiod}}}%
        {{hash=4c1946c76a98ceecd04eac7eed0dc1f7}{%
           family={Garg},
           familyi={G\bibinitperiod},
           given={Lakshya},
           giveni={L\bibinitperiod}}}%
        {{hash=42db2cd1749c72fa981f7ded523ada84}{%
           family={A},
           familyi={A\bibinitperiod},
           given={Lavender},
           giveni={L\bibinitperiod}}}%
        {{hash=1bf64285bb5330d70f13953440473a9a}{%
           family={Silva},
           familyi={S\bibinitperiod},
           given={Leandro},
           giveni={L\bibinitperiod}}}%
        {{hash=33fa3cdf541304a618bccc17fea57951}{%
           family={Bell},
           familyi={B\bibinitperiod},
           given={Lee},
           giveni={L\bibinitperiod}}}%
        {{hash=f4a4cbf770add19c206827116c68732e}{%
           family={Zhang},
           familyi={Z\bibinitperiod},
           given={Lei},
           giveni={L\bibinitperiod}}}%
        {{hash=516629b4d6f6f498f0b66fe2a90453f1}{%
           family={Guo},
           familyi={G\bibinitperiod},
           given={Liangpeng},
           giveni={L\bibinitperiod}}}%
        {{hash=be39c121bc7a07fa378493551b4a44c6}{%
           family={Yu},
           familyi={Y\bibinitperiod},
           given={Licheng},
           giveni={L\bibinitperiod}}}%
        {{hash=46b604ad3ed4cb60aeb537d78683a957}{%
           family={Moshkovich},
           familyi={M\bibinitperiod},
           given={Liron},
           giveni={L\bibinitperiod}}}%
        {{hash=484beeb805e576ed3bdb038c726f4959}{%
           family={Wehrstedt},
           familyi={W\bibinitperiod},
           given={Luca},
           giveni={L\bibinitperiod}}}%
        {{hash=2118ff6f53e7a26f72795cd86e0272e3}{%
           family={Khabsa},
           familyi={K\bibinitperiod},
           given={Madian},
           giveni={M\bibinitperiod}}}%
        {{hash=3e4f7696f3195621b9f462ed525356a7}{%
           family={Avalani},
           familyi={A\bibinitperiod},
           given={Manav},
           giveni={M\bibinitperiod}}}%
        {{hash=6f5d030d498f6e477b5966621575bba3}{%
           family={Bhatt},
           familyi={B\bibinitperiod},
           given={Manish},
           giveni={M\bibinitperiod}}}%
        {{hash=214d095b77c87bf3ca44fb9fdb919a22}{%
           family={Mankus},
           familyi={M\bibinitperiod},
           given={Martynas},
           giveni={M\bibinitperiod}}}%
        {{hash=843c622abc3fba6607bd660289251fa3}{%
           family={Hasson},
           familyi={H\bibinitperiod},
           given={Matan},
           giveni={M\bibinitperiod}}}%
        {{hash=e1761bb9763e5e762225ab7276392c5c}{%
           family={Lennie},
           familyi={L\bibinitperiod},
           given={Matthew},
           giveni={M\bibinitperiod}}}%
        {{hash=525237a0a8567b38319596dc54130c17}{%
           family={Reso},
           familyi={R\bibinitperiod},
           given={Matthias},
           giveni={M\bibinitperiod}}}%
        {{hash=9fb44e80abf1fa021cccac0860d5e882}{%
           family={Groshev},
           familyi={G\bibinitperiod},
           given={Maxim},
           giveni={M\bibinitperiod}}}%
        {{hash=c1805b2dbda273718fab95ee7582f4bf}{%
           family={Naumov},
           familyi={N\bibinitperiod},
           given={Maxim},
           giveni={M\bibinitperiod}}}%
        {{hash=0b5be788efcc10f366aa0a94b20fe4b9}{%
           family={Lathi},
           familyi={L\bibinitperiod},
           given={Maya},
           giveni={M\bibinitperiod}}}%
        {{hash=1b5a1f51491e8a8f32e8817961f6ffb9}{%
           family={Keneally},
           familyi={K\bibinitperiod},
           given={Meghan},
           giveni={M\bibinitperiod}}}%
        {{hash=0474cc7d2cd3785ad22074a7b4abeb8b}{%
           family={Liu},
           familyi={L\bibinitperiod},
           given={Miao},
           giveni={M\bibinitperiod}}}%
        {{hash=57e3d899218bce9cfe05fae5fadb5f32}{%
           family={Seltzer},
           familyi={S\bibinitperiod},
           given={Michael\bibnamedelima L.},
           giveni={M\bibinitperiod\bibinitdelim L\bibinitperiod}}}%
        {{hash=e25b9b55e0d33d8e554fb428b0122ba9}{%
           family={Valko},
           familyi={V\bibinitperiod},
           given={Michal},
           giveni={M\bibinitperiod}}}%
        {{hash=04cab131fdae8df59ad85786012e0958}{%
           family={Restrepo},
           familyi={R\bibinitperiod},
           given={Michelle},
           giveni={M\bibinitperiod}}}%
        {{hash=0978b7a664572d10be33e089a43fabb3}{%
           family={Patel},
           familyi={P\bibinitperiod},
           given={Mihir},
           giveni={M\bibinitperiod}}}%
        {{hash=1f4f7f284fd53ba80361ded56d164beb}{%
           family={Vyatskov},
           familyi={V\bibinitperiod},
           given={Mik},
           giveni={M\bibinitperiod}}}%
        {{hash=c76172ee0c2ebda81796624b4a81ae54}{%
           family={Samvelyan},
           familyi={S\bibinitperiod},
           given={Mikayel},
           giveni={M\bibinitperiod}}}%
        {{hash=84666a285b6823b0dd9c9650fc5302b8}{%
           family={Clark},
           familyi={C\bibinitperiod},
           given={Mike},
           giveni={M\bibinitperiod}}}%
        {{hash=e3b7d3ac3c41fc36ca2ef0ced3c002dc}{%
           family={Macey},
           familyi={M\bibinitperiod},
           given={Mike},
           giveni={M\bibinitperiod}}}%
        {{hash=12c4fa347402de7d37d2afca53eaeafa}{%
           family={Wang},
           familyi={W\bibinitperiod},
           given={Mike},
           giveni={M\bibinitperiod}}}%
        {{hash=551f0565843ce1ed2171ac143389a806}{%
           family={Hermoso},
           familyi={H\bibinitperiod},
           given={Miquel\bibnamedelima Jubert},
           giveni={M\bibinitperiod\bibinitdelim J\bibinitperiod}}}%
        {{hash=1e85fc0bfe1b19bd3ef45a62aaf57028}{%
           family={Metanat},
           familyi={M\bibinitperiod},
           given={Mo},
           giveni={M\bibinitperiod}}}%
        {{hash=6e8b3d38b127f6e4cb3d429818c0fac8}{%
           family={Rastegari},
           familyi={R\bibinitperiod},
           given={Mohammad},
           giveni={M\bibinitperiod}}}%
        {{hash=65085c9b21420333482c003abb19468e}{%
           family={Bansal},
           familyi={B\bibinitperiod},
           given={Munish},
           giveni={M\bibinitperiod}}}%
        {{hash=361e3b1f0e54cfc90f70d2b0bb66997f}{%
           family={Santhanam},
           familyi={S\bibinitperiod},
           given={Nandhini},
           giveni={N\bibinitperiod}}}%
        {{hash=59d8b34d1d4e1679c5bac7e159a41489}{%
           family={Parks},
           familyi={P\bibinitperiod},
           given={Natascha},
           giveni={N\bibinitperiod}}}%
        {{hash=b00d242b09ee167e04b67656c6f7606e}{%
           family={White},
           familyi={W\bibinitperiod},
           given={Natasha},
           giveni={N\bibinitperiod}}}%
        {{hash=78b25d3076bbe3ee363aae67c0efbf02}{%
           family={Bawa},
           familyi={B\bibinitperiod},
           given={Navyata},
           giveni={N\bibinitperiod}}}%
        {{hash=e898c478735b6cf02851f3193ad09bd9}{%
           family={Singhal},
           familyi={S\bibinitperiod},
           given={Nayan},
           giveni={N\bibinitperiod}}}%
        {{hash=97aa82e640185022596b22bca0ef300c}{%
           family={Egebo},
           familyi={E\bibinitperiod},
           given={Nick},
           giveni={N\bibinitperiod}}}%
        {{hash=26e026be6d5366fce878100ba03d68c1}{%
           family={Usunier},
           familyi={U\bibinitperiod},
           given={Nicolas},
           giveni={N\bibinitperiod}}}%
        {{hash=093485a23f5ff6c5f297acabc67a9a98}{%
           family={Mehta},
           familyi={M\bibinitperiod},
           given={Nikhil},
           giveni={N\bibinitperiod}}}%
        {{hash=e223633878a94510de938c3067713e4d}{%
           family={Laptev},
           familyi={L\bibinitperiod},
           given={Nikolay\bibnamedelima Pavlovich},
           giveni={N\bibinitperiod\bibinitdelim P\bibinitperiod}}}%
        {{hash=5d4e37543d0a89c80560b2dbf014118e}{%
           family={Dong},
           familyi={D\bibinitperiod},
           given={Ning},
           giveni={N\bibinitperiod}}}%
        {{hash=6e32934aad5bb7752713e459961e0100}{%
           family={Cheng},
           familyi={C\bibinitperiod},
           given={Norman},
           giveni={N\bibinitperiod}}}%
        {{hash=ef6569ed842d1879c34afafd032057a7}{%
           family={Chernoguz},
           familyi={C\bibinitperiod},
           given={Oleg},
           giveni={O\bibinitperiod}}}%
        {{hash=46abce9f68c25ae9656bd93949debc05}{%
           family={Hart},
           familyi={H\bibinitperiod},
           given={Olivia},
           giveni={O\bibinitperiod}}}%
        {{hash=5466d745ccee0c7909ef89b2f94f8e08}{%
           family={Salpekar},
           familyi={S\bibinitperiod},
           given={Omkar},
           giveni={O\bibinitperiod}}}%
        {{hash=561024889f4a812f6cb7d9063bcf1d83}{%
           family={Kalinli},
           familyi={K\bibinitperiod},
           given={Ozlem},
           giveni={O\bibinitperiod}}}%
        {{hash=b6a785629bec552dd1dc659a7b81ff78}{%
           family={Kent},
           familyi={K\bibinitperiod},
           given={Parkin},
           giveni={P\bibinitperiod}}}%
        {{hash=8e2b190b86f26285662a8e910614422c}{%
           family={Parekh},
           familyi={P\bibinitperiod},
           given={Parth},
           giveni={P\bibinitperiod}}}%
        {{hash=a582947a894c4f27a43566adf5904b09}{%
           family={Saab},
           familyi={S\bibinitperiod},
           given={Paul},
           giveni={P\bibinitperiod}}}%
        {{hash=2cd3bd4809dbde380ae860afaa14b96f}{%
           family={Balaji},
           familyi={B\bibinitperiod},
           given={Pavan},
           giveni={P\bibinitperiod}}}%
        {{hash=4696787aed627eba66219d10375b6128}{%
           family={Rittner},
           familyi={R\bibinitperiod},
           given={Pedro},
           giveni={P\bibinitperiod}}}%
        {{hash=4505e041f77b137101094a2522aed23c}{%
           family={Bontrager},
           familyi={B\bibinitperiod},
           given={Philip},
           giveni={P\bibinitperiod}}}%
        {{hash=8ba9a81fd07b2afc16974cc75cf15e44}{%
           family={Roux},
           familyi={R\bibinitperiod},
           given={Pierre},
           giveni={P\bibinitperiod}}}%
        {{hash=37843fd1a96680e7945ac1a059b6e8b8}{%
           family={Dollar},
           familyi={D\bibinitperiod},
           given={Piotr},
           giveni={P\bibinitperiod}}}%
        {{hash=adcb9674130166d4fa309e9d5f19f59e}{%
           family={Zvyagina},
           familyi={Z\bibinitperiod},
           given={Polina},
           giveni={P\bibinitperiod}}}%
        {{hash=4497eb0b3d2072c0fb4bb0551f2324bd}{%
           family={Ratanchandani},
           familyi={R\bibinitperiod},
           given={Prashant},
           giveni={P\bibinitperiod}}}%
        {{hash=62888c883b7e544f3a3a50615d636636}{%
           family={Yuvraj},
           familyi={Y\bibinitperiod},
           given={Pritish},
           giveni={P\bibinitperiod}}}%
        {{hash=7484697c75d89fdf767ab363a99d7137}{%
           family={Liang},
           familyi={L\bibinitperiod},
           given={Qian},
           giveni={Q\bibinitperiod}}}%
        {{hash=0e73c5981dca93e449b0efb107db6db6}{%
           family={Alao},
           familyi={A\bibinitperiod},
           given={Rachad},
           giveni={R\bibinitperiod}}}%
        {{hash=3f382a8348081765315e0446d6f403a8}{%
           family={Rodriguez},
           familyi={R\bibinitperiod},
           given={Rachel},
           giveni={R\bibinitperiod}}}%
        {{hash=b174cc506ed225668695f2609de76e3f}{%
           family={Ayub},
           familyi={A\bibinitperiod},
           given={Rafi},
           giveni={R\bibinitperiod}}}%
        {{hash=f17734bc656d4669ac3abc24701d4edf}{%
           family={Murthy},
           familyi={M\bibinitperiod},
           given={Raghotham},
           giveni={R\bibinitperiod}}}%
        {{hash=5da021d30571b56410defdad33c2e35b}{%
           family={Nayani},
           familyi={N\bibinitperiod},
           given={Raghu},
           giveni={R\bibinitperiod}}}%
        {{hash=058e8580308268593962390f561faa2a}{%
           family={Mitra},
           familyi={M\bibinitperiod},
           given={Rahul},
           giveni={R\bibinitperiod}}}%
        {{hash=e46735bc94d62c1088fc89ac05a123ad}{%
           family={Parthasarathy},
           familyi={P\bibinitperiod},
           given={Rangaprabhu},
           giveni={R\bibinitperiod}}}%
        {{hash=c1759f73dac024a1af9f576ddaa00100}{%
           family={Li},
           familyi={L\bibinitperiod},
           given={Raymond},
           giveni={R\bibinitperiod}}}%
        {{hash=01eddc92feded963d2f72d2412e9f396}{%
           family={Hogan},
           familyi={H\bibinitperiod},
           given={Rebekkah},
           giveni={R\bibinitperiod}}}%
        {{hash=dbf8d9ec4075dd9a2fe082c2f8d0ac72}{%
           family={Battey},
           familyi={B\bibinitperiod},
           given={Robin},
           giveni={R\bibinitperiod}}}%
        {{hash=6940d52693f30b2bb9a4473706040190}{%
           family={Wang},
           familyi={W\bibinitperiod},
           given={Rocky},
           giveni={R\bibinitperiod}}}%
        {{hash=5138c225dc242e3f114b9da707387511}{%
           family={Howes},
           familyi={H\bibinitperiod},
           given={Russ},
           giveni={R\bibinitperiod}}}%
        {{hash=df656146081384635aff4a9c77caf560}{%
           family={Rinott},
           familyi={R\bibinitperiod},
           given={Ruty},
           giveni={R\bibinitperiod}}}%
        {{hash=90feecf4f2f08ae7f3b8e33214091f72}{%
           family={Mehta},
           familyi={M\bibinitperiod},
           given={Sachin},
           giveni={S\bibinitperiod}}}%
        {{hash=72ec8005ba6d04081e4d030f6acb5f36}{%
           family={Siby},
           familyi={S\bibinitperiod},
           given={Sachin},
           giveni={S\bibinitperiod}}}%
        {{hash=958e1bcb3b330bcdb2831c11b58d94d4}{%
           family={Bondu},
           familyi={B\bibinitperiod},
           given={Sai\bibnamedelima Jayesh},
           giveni={S\bibinitperiod\bibinitdelim J\bibinitperiod}}}%
        {{hash=2db605f7dff5b8203e3ddbc6a04d06a8}{%
           family={Datta},
           familyi={D\bibinitperiod},
           given={Samyak},
           giveni={S\bibinitperiod}}}%
        {{hash=83b3d704d819953704f3d8a468f1dfdf}{%
           family={Chugh},
           familyi={C\bibinitperiod},
           given={Sara},
           giveni={S\bibinitperiod}}}%
        {{hash=88e7821bdca0652c6d651019f5f925de}{%
           family={Hunt},
           familyi={H\bibinitperiod},
           given={Sara},
           giveni={S\bibinitperiod}}}%
        {{hash=59e6cded8046670ba4c60e653c2af6e8}{%
           family={Dhillon},
           familyi={D\bibinitperiod},
           given={Sargun},
           giveni={S\bibinitperiod}}}%
        {{hash=5ced057cee4ef377f620b76bbec988a7}{%
           family={Sidorov},
           familyi={S\bibinitperiod},
           given={Sasha},
           giveni={S\bibinitperiod}}}%
        {{hash=7c837fcacb7310e658a14a018c0b8693}{%
           family={Pan},
           familyi={P\bibinitperiod},
           given={Satadru},
           giveni={S\bibinitperiod}}}%
        {{hash=c30c1797171696f84e66916c49e9399b}{%
           family={Mahajan},
           familyi={M\bibinitperiod},
           given={Saurabh},
           giveni={S\bibinitperiod}}}%
        {{hash=be9199e2769b280d8e77f985de477790}{%
           family={Verma},
           familyi={V\bibinitperiod},
           given={Saurabh},
           giveni={S\bibinitperiod}}}%
        {{hash=1062b9e0f56fa30ed0a08eb73a68cd55}{%
           family={Yamamoto},
           familyi={Y\bibinitperiod},
           given={Seiji},
           giveni={S\bibinitperiod}}}%
        {{hash=f8f3cf465fedf0755bf26602fe05a5d3}{%
           family={Ramaswamy},
           familyi={R\bibinitperiod},
           given={Sharadh},
           giveni={S\bibinitperiod}}}%
        {{hash=6b54dbf4b3be2a123135dfdd1420ec32}{%
           family={Lindsay},
           familyi={L\bibinitperiod},
           given={Shaun},
           giveni={S\bibinitperiod}}}%
        {{hash=6b54dbf4b3be2a123135dfdd1420ec32}{%
           family={Lindsay},
           familyi={L\bibinitperiod},
           given={Shaun},
           giveni={S\bibinitperiod}}}%
        {{hash=172cdc3272a4a6fc64f5ee3792950ef4}{%
           family={Feng},
           familyi={F\bibinitperiod},
           given={Sheng},
           giveni={S\bibinitperiod}}}%
        {{hash=51b8004fa93e880b6584ed12b5472fc6}{%
           family={Lin},
           familyi={L\bibinitperiod},
           given={Shenghao},
           giveni={S\bibinitperiod}}}%
        {{hash=6950cf3c852aa626e12e9607f46cf864}{%
           family={Zha},
           familyi={Z\bibinitperiod},
           given={Shengxin\bibnamedelima Cindy},
           giveni={S\bibinitperiod\bibinitdelim C\bibinitperiod}}}%
        {{hash=e0eb0651673983a0cd132dba24d5dc7f}{%
           family={Patil},
           familyi={P\bibinitperiod},
           given={Shishir},
           giveni={S\bibinitperiod}}}%
        {{hash=eab9dab4b3286059e4ba07f8493313ca}{%
           family={Shankar},
           familyi={S\bibinitperiod},
           given={Shiva},
           giveni={S\bibinitperiod}}}%
        {{hash=f263556bc4337effab2effa8385dd0df}{%
           family={Zhang},
           familyi={Z\bibinitperiod},
           given={Shuqiang},
           giveni={S\bibinitperiod}}}%
        {{hash=f263556bc4337effab2effa8385dd0df}{%
           family={Zhang},
           familyi={Z\bibinitperiod},
           given={Shuqiang},
           giveni={S\bibinitperiod}}}%
        {{hash=27edaeac6106fc95a1e9855b71069c26}{%
           family={Wang},
           familyi={W\bibinitperiod},
           given={Sinong},
           giveni={S\bibinitperiod}}}%
        {{hash=71affa1854c02810f731258a9f269935}{%
           family={Agarwal},
           familyi={A\bibinitperiod},
           given={Sneha},
           giveni={S\bibinitperiod}}}%
        {{hash=3757c94a3a9be01806970f24b1f4bfde}{%
           family={Sajuyigbe},
           familyi={S\bibinitperiod},
           given={Soji},
           giveni={S\bibinitperiod}}}%
        {{hash=8ef51a0906e47d2b4472c4e714ed598f}{%
           family={Chintala},
           familyi={C\bibinitperiod},
           given={Soumith},
           giveni={S\bibinitperiod}}}%
        {{hash=0508d45ce03b11237571e4919e8cfa08}{%
           family={Max},
           familyi={M\bibinitperiod},
           given={Stephanie},
           giveni={S\bibinitperiod}}}%
        {{hash=0180842ca4dde7937e004e9fbca913c2}{%
           family={Chen},
           familyi={C\bibinitperiod},
           given={Stephen},
           giveni={S\bibinitperiod}}}%
        {{hash=f6bb2fa63b48b0faba8e9415b69d76a2}{%
           family={Kehoe},
           familyi={K\bibinitperiod},
           given={Steve},
           giveni={S\bibinitperiod}}}%
        {{hash=dd565279a6b3ff997202996841f578cb}{%
           family={Satterfield},
           familyi={S\bibinitperiod},
           given={Steve},
           giveni={S\bibinitperiod}}}%
        {{hash=564ecaf17c00b623be2bcded3d1b7eb2}{%
           family={Govindaprasad},
           familyi={G\bibinitperiod},
           given={Sudarshan},
           giveni={S\bibinitperiod}}}%
        {{hash=9e28347d47434d68b2a810946e3485fd}{%
           family={Gupta},
           familyi={G\bibinitperiod},
           given={Sumit},
           giveni={S\bibinitperiod}}}%
        {{hash=700be19f5f7477ed2c36138289fbe5a5}{%
           family={Deng},
           familyi={D\bibinitperiod},
           given={Summer},
           giveni={S\bibinitperiod}}}%
        {{hash=30b4a0c2ecac8d883b69e3f004e55d27}{%
           family={Cho},
           familyi={C\bibinitperiod},
           given={Sungmin},
           giveni={S\bibinitperiod}}}%
        {{hash=68df331a61e3a351ce19811368fdd067}{%
           family={Virk},
           familyi={V\bibinitperiod},
           given={Sunny},
           giveni={S\bibinitperiod}}}%
        {{hash=7fcd1f73d9a52ad49a219a1e25a166ed}{%
           family={Subramanian},
           familyi={S\bibinitperiod},
           given={Suraj},
           giveni={S\bibinitperiod}}}%
        {{hash=9996a6cd3bf7158800249fdf7f52d3f3}{%
           family={Choudhury},
           familyi={C\bibinitperiod},
           given={Sy},
           giveni={S\bibinitperiod}}}%
        {{hash=c37fab903dfa8498dac5064d423441eb}{%
           family={Goldman},
           familyi={G\bibinitperiod},
           given={Sydney},
           giveni={S\bibinitperiod}}}%
        {{hash=cc980e5dc4f117cc7b9dc8e79b4e538d}{%
           family={Remez},
           familyi={R\bibinitperiod},
           given={Tal},
           giveni={T\bibinitperiod}}}%
        {{hash=a6692f2be771da60579cf3f160cc0be8}{%
           family={Glaser},
           familyi={G\bibinitperiod},
           given={Tamar},
           giveni={T\bibinitperiod}}}%
        {{hash=05eb2734ca563c20d2dfadefb2973ba3}{%
           family={Best},
           familyi={B\bibinitperiod},
           given={Tamara},
           giveni={T\bibinitperiod}}}%
        {{hash=ca4f7b89c24e08ebcf0109111421d8bb}{%
           family={Koehler},
           familyi={K\bibinitperiod},
           given={Thilo},
           giveni={T\bibinitperiod}}}%
        {{hash=1697c358b1d32c9b823a0f1883412819}{%
           family={Robinson},
           familyi={R\bibinitperiod},
           given={Thomas},
           giveni={T\bibinitperiod}}}%
        {{hash=0046d26b2b4052fa6b3b344a6f8126ee}{%
           family={Li},
           familyi={L\bibinitperiod},
           given={Tianhe},
           giveni={T\bibinitperiod}}}%
        {{hash=4088b3179b8029fdfca2b8a81ad73482}{%
           family={Zhang},
           familyi={Z\bibinitperiod},
           given={Tianjun},
           giveni={T\bibinitperiod}}}%
        {{hash=b7dcaf9fce703c51d1ac1b4f5afd2a29}{%
           family={Matthews},
           familyi={M\bibinitperiod},
           given={Tim},
           giveni={T\bibinitperiod}}}%
        {{hash=3ababcb228e63da7fe96b75788a47e25}{%
           family={Chou},
           familyi={C\bibinitperiod},
           given={Timothy},
           giveni={T\bibinitperiod}}}%
        {{hash=4cdbcf9741b50037d4d1273d510833ed}{%
           family={Shaked},
           familyi={S\bibinitperiod},
           given={Tzook},
           giveni={T\bibinitperiod}}}%
        {{hash=58f83a9c712937310623c47e5192e338}{%
           family={Vontimitta},
           familyi={V\bibinitperiod},
           given={Varun},
           giveni={V\bibinitperiod}}}%
        {{hash=a7372ea8eb2ce633a7fe3a6812880b3d}{%
           family={Ajayi},
           familyi={A\bibinitperiod},
           given={Victoria},
           giveni={V\bibinitperiod}}}%
        {{hash=a0e4f3fc01449993959fea1a010a6ae1}{%
           family={Montanez},
           familyi={M\bibinitperiod},
           given={Victoria},
           giveni={V\bibinitperiod}}}%
        {{hash=37a943a6ed693c46a1b8e75c5fa0ab11}{%
           family={Mohan},
           familyi={M\bibinitperiod},
           given={Vijai},
           giveni={V\bibinitperiod}}}%
        {{hash=19b1ff4a1c794ef2a3092e64edfd242e}{%
           family={Kumar},
           familyi={K\bibinitperiod},
           given={Vinay\bibnamedelima Satish},
           giveni={V\bibinitperiod\bibinitdelim S\bibinitperiod}}}%
        {{hash=9948579cb847e595860139cb4781700b}{%
           family={Mangla},
           familyi={M\bibinitperiod},
           given={Vishal},
           giveni={V\bibinitperiod}}}%
        {{hash=b224aff86fbef658cf05781db43ca56c}{%
           family={Ionescu},
           familyi={I\bibinitperiod},
           given={Vlad},
           giveni={V\bibinitperiod}}}%
        {{hash=a613ee99480541cdb9a75d1ab03866a4}{%
           family={Poenaru},
           familyi={P\bibinitperiod},
           given={Vlad},
           giveni={V\bibinitperiod}}}%
        {{hash=038e6532c4f02b7cbed0a1bb7745a108}{%
           family={Mihailescu},
           familyi={M\bibinitperiod},
           given={Vlad\bibnamedelima Tiberiu},
           giveni={V\bibinitperiod\bibinitdelim T\bibinitperiod}}}%
        {{hash=9c72a73cdab75ff72f0eb6bf5368d696}{%
           family={Ivanov},
           familyi={I\bibinitperiod},
           given={Vladimir},
           giveni={V\bibinitperiod}}}%
        {{hash=be6f1b6df7f1ddfafad18806238fa391}{%
           family={Li},
           familyi={L\bibinitperiod},
           given={Wei},
           giveni={W\bibinitperiod}}}%
        {{hash=062c436b41e44cf5ce96a8e379d3e1cf}{%
           family={Wang},
           familyi={W\bibinitperiod},
           given={Wenchen},
           giveni={W\bibinitperiod}}}%
        {{hash=e18a25a32880102eab726a6382408539}{%
           family={Jiang},
           familyi={J\bibinitperiod},
           given={Wenwen},
           giveni={W\bibinitperiod}}}%
        {{hash=eb72b2b69c876043447ddfcdef122961}{%
           family={Bouaziz},
           familyi={B\bibinitperiod},
           given={Wes},
           giveni={W\bibinitperiod}}}%
        {{hash=4766072c6524173c5b352a44b4e81ea2}{%
           family={Constable},
           familyi={C\bibinitperiod},
           given={Will},
           giveni={W\bibinitperiod}}}%
        {{hash=515c440104a8f1df12f8e45203cb9e39}{%
           family={Tang},
           familyi={T\bibinitperiod},
           given={Xiaocheng},
           giveni={X\bibinitperiod}}}%
        {{hash=cee3d25b43fc4c696b02624e1bb87885}{%
           family={Wu},
           familyi={W\bibinitperiod},
           given={Xiaojian},
           giveni={X\bibinitperiod}}}%
        {{hash=5986e7edcef792c198bc335834a6d754}{%
           family={Wang},
           familyi={W\bibinitperiod},
           given={Xiaolan},
           giveni={X\bibinitperiod}}}%
        {{hash=fefa2bfb82ea505f49180c1ca648280a}{%
           family={Wu},
           familyi={W\bibinitperiod},
           given={Xilun},
           giveni={X\bibinitperiod}}}%
        {{hash=5cc2d4e78c57c05664f761bd22543685}{%
           family={Gao},
           familyi={G\bibinitperiod},
           given={Xinbo},
           giveni={X\bibinitperiod}}}%
        {{hash=b54e3b30ac4444068135b13c8fe614c8}{%
           family={Kleinman},
           familyi={K\bibinitperiod},
           given={Yaniv},
           giveni={Y\bibinitperiod}}}%
        {{hash=bb01d83790d67da25dc003607f5c73ef}{%
           family={Chen},
           familyi={C\bibinitperiod},
           given={Yanjun},
           giveni={Y\bibinitperiod}}}%
        {{hash=e2da8a623ffb9d1af7c892950724d331}{%
           family={Hu},
           familyi={H\bibinitperiod},
           given={Ye},
           giveni={Y\bibinitperiod}}}%
        {{hash=d3a49a660fa8a6c8a93b5273a70eae29}{%
           family={Jia},
           familyi={J\bibinitperiod},
           given={Ye},
           giveni={Y\bibinitperiod}}}%
        {{hash=d1999e72113e85b3257e4c75e03265dc}{%
           family={Qi},
           familyi={Q\bibinitperiod},
           given={Ye},
           giveni={Y\bibinitperiod}}}%
        {{hash=7116d11eb4ba09bcaa84c94d2c55ce1f}{%
           family={Li},
           familyi={L\bibinitperiod},
           given={Yenda},
           giveni={Y\bibinitperiod}}}%
        {{hash=8a3b8dcf7b5b2a6961827725ee30c8bc}{%
           family={Zhang},
           familyi={Z\bibinitperiod},
           given={Yilin},
           giveni={Y\bibinitperiod}}}%
        {{hash=f5acec98b29ee91fa6b08b85a6a0adad}{%
           family={Zhang},
           familyi={Z\bibinitperiod},
           given={Ying},
           giveni={Y\bibinitperiod}}}%
        {{hash=b524686c039bdbe0e8cca661fca6b56c}{%
           family={Adi},
           familyi={A\bibinitperiod},
           given={Yossi},
           giveni={Y\bibinitperiod}}}%
        {{hash=e0933c3e694db6a888aaaf900cce2591}{%
           family={Nam},
           familyi={N\bibinitperiod},
           given={Youngjin},
           giveni={Y\bibinitperiod}}}%
        {{hash=0af2884fd29ac4bed46fc56851d95768}{%
           family={Yu},
           familyi={Y\bibinitperiod}}}%
        {{hash=957b05eb2d9bfaf59947e44a46c3c7b3}{%
           family={Wang},
           familyi={W\bibinitperiod}}}%
        {{hash=26500c0e7c5f37a79d71416c4c641ba2}{%
           family={Zhao},
           familyi={Z\bibinitperiod},
           given={Yu},
           giveni={Y\bibinitperiod}}}%
        {{hash=9f036802451721cb52c6a89a142c54de}{%
           family={Hao},
           familyi={H\bibinitperiod},
           given={Yuchen},
           giveni={Y\bibinitperiod}}}%
        {{hash=76f55ca261965fc4d519b5f859435a0b}{%
           family={Qian},
           familyi={Q\bibinitperiod},
           given={Yundi},
           giveni={Y\bibinitperiod}}}%
        {{hash=7b1b1d1305fa722b98ca9ba3492c1432}{%
           family={Li},
           familyi={L\bibinitperiod},
           given={Yunlu},
           giveni={Y\bibinitperiod}}}%
        {{hash=778e12ba06de6c9a9e60fdc7ad0d91c8}{%
           family={He},
           familyi={H\bibinitperiod},
           given={Yuzi},
           giveni={Y\bibinitperiod}}}%
        {{hash=02bbf2f73d4317c775ba326c6627ad25}{%
           family={Rait},
           familyi={R\bibinitperiod},
           given={Zach},
           giveni={Z\bibinitperiod}}}%
        {{hash=3f9535be511fd2fa346093e63b8e61a0}{%
           family={DeVito},
           familyi={D\bibinitperiod},
           given={Zachary},
           giveni={Z\bibinitperiod}}}%
        {{hash=3cd9976f573478e1d3885145b189c211}{%
           family={Rosnbrick},
           familyi={R\bibinitperiod},
           given={Zef},
           giveni={Z\bibinitperiod}}}%
        {{hash=598a1e3eb86f739e497ce17c7df7f863}{%
           family={Wen},
           familyi={W\bibinitperiod},
           given={Zhaoduo},
           giveni={Z\bibinitperiod}}}%
        {{hash=ebdd3afe60231d8067ed9e08883de58c}{%
           family={Yang},
           familyi={Y\bibinitperiod},
           given={Zhenyu},
           giveni={Z\bibinitperiod}}}%
        {{hash=a69e8330df4afe0adb0a8ed1f744195d}{%
           family={Zhao},
           familyi={Z\bibinitperiod},
           given={Zhiwei},
           giveni={Z\bibinitperiod}}}%
        {{hash=dfacbe26a77fba7d2303522d43096f47}{%
           family={Ma},
           familyi={M\bibinitperiod},
           given={Zhiyu},
           giveni={Z\bibinitperiod}}}%
      }
      \strng{namehash}{fd6db63ae85e705fb7f916f99c58faa2}
      \strng{fullhash}{8960c0d6de0c5c898d885796a71a0a19}
      \strng{bibnamehash}{fd6db63ae85e705fb7f916f99c58faa2}
      \strng{authorbibnamehash}{fd6db63ae85e705fb7f916f99c58faa2}
      \strng{authornamehash}{fd6db63ae85e705fb7f916f99c58faa2}
      \strng{authorfullhash}{8960c0d6de0c5c898d885796a71a0a19}
      \field{sortinit}{3}
      \field{sortinithash}{ad6fe7482ffbd7b9f99c9e8b5dccd3d7}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{abstract}{Modern artificial intelligence (AI) systems are powered by foundation models. This paper presents a new set of foundation models, called Llama 3. It is a herd of language models that natively support multilinguality, coding, reasoning, and tool usage. Our largest model is a dense Transformer with 405B parameters and a context window of up to 128K tokens. This paper presents an extensive empirical evaluation of Llama 3. We find that Llama 3 delivers comparable quality to leading language models such as GPT-4 on a plethora of tasks. We publicly release Llama 3, including pre-trained and post-trained versions of the 405B parameter language model and our Llama Guard 3 model for input and output safety. The paper also presents the results of experiments in which we integrate image, video, and speech capabilities into Llama 3 via a compositional approach. We observe this approach performs competitively with the state-of-the-art on image, video, and speech recognition tasks. The resulting models are not yet being broadly released as they are still under development.}
      \field{day}{23}
      \field{eprinttype}{arXiv}
      \field{howpublished}{arXiv: 2407.21783 (Only available as arXiv preprint)}
      \field{month}{11}
      \field{pubstate}{prepublished}
      \field{title}{The {{Llama}} 3 {{Herd}} of {{Models}}}
      \field{urlday}{19}
      \field{urlmonth}{3}
      \field{urlyear}{2025}
      \field{year}{2024}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \verb{doi}
      \verb 10.48550/arXiv.2407.21783
      \endverb
      \verb{eprint}
      \verb 2407.21783
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/PZG4PIHM/Grattafiori et al. - 2024 - The Llama 3 Herd of Models.pdf;/Users/landes/opt/var/zotero/storage/YJZ65JTT/2407.html
      \endverb
      \verb{urlraw}
      \verb http://arxiv.org/abs/2407.21783
      \endverb
      \verb{url}
      \verb http://arxiv.org/abs/2407.21783
      \endverb
      \keyw{Computer Science - Artificial Intelligence,Computer Science - Computation and Language,Computer Science - Computer Vision and Pattern Recognition}
    \endentry
    \entry{touvronLLaMAOpenEfficient2023}{misc}{}
      \name{author}{14}{}{%
        {{hash=a2a13fcd633ec70c55a7f3f4812afdcf}{%
           family={Touvron},
           familyi={T\bibinitperiod},
           given={Hugo},
           giveni={H\bibinitperiod}}}%
        {{hash=c641a91d616b6eda08cbbdca7b7eb186}{%
           family={Lavril},
           familyi={L\bibinitperiod},
           given={Thibaut},
           giveni={T\bibinitperiod}}}%
        {{hash=a32ece3bc966e7e88747e905158c9a6a}{%
           family={Izacard},
           familyi={I\bibinitperiod},
           given={Gautier},
           giveni={G\bibinitperiod}}}%
        {{hash=7222f9d76b0fff504f39e7c9c2a526be}{%
           family={Martinet},
           familyi={M\bibinitperiod},
           given={Xavier},
           giveni={X\bibinitperiod}}}%
        {{hash=08284515d256b832e9dba10a88af84f4}{%
           family={Lachaux},
           familyi={L\bibinitperiod},
           given={Marie-Anne},
           giveni={M\bibinithyphendelim A\bibinitperiod}}}%
        {{hash=1d29ae55d8d993d9f195b3c97bd34f7c}{%
           family={Lacroix},
           familyi={L\bibinitperiod},
           given={Timothée},
           giveni={T\bibinitperiod}}}%
        {{hash=e0d9a8657c1043f53c54f3f5a6ff305f}{%
           family={Rozière},
           familyi={R\bibinitperiod},
           given={Baptiste},
           giveni={B\bibinitperiod}}}%
        {{hash=78a420900f50a8470ad085fb05231bf6}{%
           family={Goyal},
           familyi={G\bibinitperiod},
           given={Naman},
           giveni={N\bibinitperiod}}}%
        {{hash=00ce63f55ae2ce6ea638e5f991996584}{%
           family={Hambro},
           familyi={H\bibinitperiod},
           given={Eric},
           giveni={E\bibinitperiod}}}%
        {{hash=5373a3313da61427121b3e9733df1ed2}{%
           family={Azhar},
           familyi={A\bibinitperiod},
           given={Faisal},
           giveni={F\bibinitperiod}}}%
        {{hash=a829e25f1d50c3545ed8e99f12890acc}{%
           family={Rodriguez},
           familyi={R\bibinitperiod},
           given={Aurelien},
           giveni={A\bibinitperiod}}}%
        {{hash=977d047821122d1c2e7aa855c30c8cf2}{%
           family={Joulin},
           familyi={J\bibinitperiod},
           given={Armand},
           giveni={A\bibinitperiod}}}%
        {{hash=ebdea2c3aa9f759075733b20dce6b873}{%
           family={Grave},
           familyi={G\bibinitperiod},
           given={Edouard},
           giveni={E\bibinitperiod}}}%
        {{hash=56509a94ba6cdaf0c71304d6cf806cee}{%
           family={Lample},
           familyi={L\bibinitperiod},
           given={Guillaume},
           giveni={G\bibinitperiod}}}%
      }
      \strng{namehash}{c237483431fea681283a37adbb23a59f}
      \strng{fullhash}{39aeaa201007bcb705db32778f923cb2}
      \strng{bibnamehash}{c237483431fea681283a37adbb23a59f}
      \strng{authorbibnamehash}{c237483431fea681283a37adbb23a59f}
      \strng{authornamehash}{c237483431fea681283a37adbb23a59f}
      \strng{authorfullhash}{39aeaa201007bcb705db32778f923cb2}
      \field{sortinit}{3}
      \field{sortinithash}{ad6fe7482ffbd7b9f99c9e8b5dccd3d7}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{shorttitle}
      \field{abstract}{We introduce LLaMA, a collection of foundation language models ranging from 7B to 65B parameters. We train our models on trillions of tokens, and show that it is possible to train state-of-the-art models using publicly available datasets exclusively, without resorting to proprietary and inaccessible datasets. In particular, LLaMA-13B outperforms GPT-3 (175B) on most benchmarks, and LLaMA-65B is competitive with the best models, Chinchilla-70B and PaLM-540B. We release all our models to the research community.}
      \field{day}{27}
      \field{eprintclass}{cs}
      \field{eprinttype}{arXiv}
      \field{howpublished}{arXiv: 2302.13971 (Only available as arXiv preprint)}
      \field{month}{2}
      \field{pubstate}{prepublished}
      \field{shorttitle}{{{LLaMA}}}
      \field{title}{{{LLaMA}}: {{Open}} and {{Efficient Foundation Language Models}}}
      \field{urlday}{12}
      \field{urlmonth}{5}
      \field{urlyear}{2023}
      \field{year}{2023}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \verb{doi}
      \verb 10.48550/arXiv.2302.13971
      \endverb
      \verb{eprint}
      \verb 2302.13971
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/SLVYZ6D2/Touvron et al. - 2023 - LLaMA Open and Efficient Foundation Language Mode.pdf;/Users/landes/opt/var/zotero/storage/U3ZREXRQ/2302.html
      \endverb
      \verb{urlraw}
      \verb http://arxiv.org/abs/2302.13971
      \endverb
      \verb{url}
      \verb http://arxiv.org/abs/2302.13971
      \endverb
      \keyw{Computer Science - Computation and Language}
    \endentry
    \entry{devlinBERTPretrainingDeep2019}{inproceedings}{}
      \name{author}{4}{}{%
        {{hash=13202969e372bc82318f9629cbdd199b}{%
           family={Devlin},
           familyi={D\bibinitperiod},
           given={Jacob},
           giveni={J\bibinitperiod}}}%
        {{hash=a45784fe7163b45f11d166564f5d24b6}{%
           family={Chang},
           familyi={C\bibinitperiod},
           given={Ming-Wei},
           giveni={M\bibinithyphendelim W\bibinitperiod}}}%
        {{hash=8dde73b4194f5bc4230c4808f3fc1534}{%
           family={Lee},
           familyi={L\bibinitperiod},
           given={Kenton},
           giveni={K\bibinitperiod}}}%
        {{hash=b92aa283415413bb8d2a1548716d0c7d}{%
           family={Toutanova},
           familyi={T\bibinitperiod},
           given={Kristina},
           giveni={K\bibinitperiod}}}%
      }
      \strng{namehash}{ad8e2e2a80d28ade21e86852b804fc9b}
      \strng{fullhash}{e8bccd48302a14eeba57d9dce2f49ef4}
      \strng{bibnamehash}{e8bccd48302a14eeba57d9dce2f49ef4}
      \strng{authorbibnamehash}{e8bccd48302a14eeba57d9dce2f49ef4}
      \strng{authornamehash}{ad8e2e2a80d28ade21e86852b804fc9b}
      \strng{authorfullhash}{e8bccd48302a14eeba57d9dce2f49ef4}
      \field{sortinit}{3}
      \field{sortinithash}{ad6fe7482ffbd7b9f99c9e8b5dccd3d7}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{shorttitle}
      \field{abstract}{We introduce a new language representation model called BERT, which stands for Bidirectional Encoder Representations from Transformers. Unlike recent language representation models (Peters et al., 2018a; Radford et al., 2018), BERT is designed to pretrain deep bidirectional representations from unlabeled text by jointly conditioning on both left and right context in all layers. As a result, the pre-trained BERT model can be finetuned with just one additional output layer to create state-of-the-art models for a wide range of tasks, such as question answering and language inference, without substantial taskspecific architecture modifications.}
      \field{booktitle}{Proceedings of the 2019 {{Conference}} of the {{North American Chapter}} of the {{Association}} for {{Computational Linguistics}}: {{Human Language Technologies}}, {{Volume}} 1 ({{Long}} and {{Short Papers}})}
      \field{day}{2}
      \field{eventtitle}{{{NAACL-HLT}}}
      \field{langid}{english}
      \field{month}{6}
      \field{shorttitle}{{{BERT}}}
      \field{title}{{{BERT}}: {{Pre-training}} of {{Deep Bidirectional Transformers}} for {{Language Understanding}}}
      \field{year}{2019}
      \field{dateera}{ce}
      \field{pages}{4171\bibrangedash 4186}
      \range{pages}{16}
      \verb{doi}
      \verb 10.18653/v1/N19-1423
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/W6HRVP8K/Devlin et al. - BERT Pre-training of Deep Bidirectional Transform.pdf
      \endverb
      \verb{urlraw}
      \verb https://aclanthology.org/N19-1423
      \endverb
      \verb{url}
      \verb https://aclanthology.org/N19-1423
      \endverb
    \endentry
    \entry{wangSelfConsistencyImprovesChain2022}{inproceedings}{}
      \name{author}{8}{}{%
        {{hash=27d22d8f05f44b47f7dcfe9b7fb85584}{%
           family={Wang},
           familyi={W\bibinitperiod},
           given={Xuezhi},
           giveni={X\bibinitperiod}}}%
        {{hash=61331a11b490f3d927555985facd25b3}{%
           family={Wei},
           familyi={W\bibinitperiod},
           given={Jason},
           giveni={J\bibinitperiod}}}%
        {{hash=fc76f5fb256da4d423554f8e629b4321}{%
           family={Schuurmans},
           familyi={S\bibinitperiod},
           given={Dale},
           giveni={D\bibinitperiod}}}%
        {{hash=c636f146591d51579a8119b777394878}{%
           family={Le},
           familyi={L\bibinitperiod},
           given={Quoc\bibnamedelima V.},
           giveni={Q\bibinitperiod\bibinitdelim V\bibinitperiod}}}%
        {{hash=594b2be737e055817db9ad276b6bf05a}{%
           family={Chi},
           familyi={C\bibinitperiod},
           given={Ed\bibnamedelima H.},
           giveni={E\bibinitperiod\bibinitdelim H\bibinitperiod}}}%
        {{hash=a2da348cbbad750c6fe76dda9c35ffcd}{%
           family={Narang},
           familyi={N\bibinitperiod},
           given={Sharan},
           giveni={S\bibinitperiod}}}%
        {{hash=fd55b702c004c13506e70bb76a4e987c}{%
           family={Chowdhery},
           familyi={C\bibinitperiod},
           given={Aakanksha},
           giveni={A\bibinitperiod}}}%
        {{hash=797f9a226fd7356db5edc6feba1a0e87}{%
           family={Zhou},
           familyi={Z\bibinitperiod},
           given={Denny},
           giveni={D\bibinitperiod}}}%
      }
      \list{location}{1}{%
        {Kigali Rwanda}%
      }
      \list{publisher}{1}{%
        {Advances in neural information processing systems}%
      }
      \strng{namehash}{1148fc4318cebce09c5c6a4181848a72}
      \strng{fullhash}{72c0811bfd1a7d60452a3aba1fe60b98}
      \strng{bibnamehash}{1148fc4318cebce09c5c6a4181848a72}
      \strng{authorbibnamehash}{1148fc4318cebce09c5c6a4181848a72}
      \strng{authornamehash}{1148fc4318cebce09c5c6a4181848a72}
      \strng{authorfullhash}{72c0811bfd1a7d60452a3aba1fe60b98}
      \field{extraname}{2}
      \field{sortinit}{3}
      \field{sortinithash}{ad6fe7482ffbd7b9f99c9e8b5dccd3d7}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{abstract}{Chain-of-thought prompting combined with pretrained large language models has achieved encouraging results on complex reasoning tasks. In this paper, we propose a new decoding strategy, self-consistency, to replace the naive greedy decoding used in chain-of-thought prompting. It first samples a diverse set of reasoning paths instead of only taking the greedy one, and then selects the most consistent answer by marginalizing out all possible reasoning paths. Self-consistency leverages the intuition that a complex reasoning problem typically admits multiple different ways of thinking leading to its unique correct answer. Our extensive empirical evaluation shows that self-consistency boosts the performance of chain-of-thought prompting with a striking margin on a range of popular arithmetic and commonsense reasoning benchmarks, including GSM8K (+17.9\%), SVAMP (+11.0\%), AQuA (+12.2\%), StrategyQA (+6.4\%) and ARC-challenge (+3.9\%).}
      \field{booktitle}{Proceedings of the {{Eleventh International Conference}} on {{Learning Representations}}}
      \field{day}{29}
      \field{eventtitle}{{{ICLR}}}
      \field{langid}{english}
      \field{month}{9}
      \field{title}{Self-{{Consistency Improves Chain}} of {{Thought Reasoning}} in {{Language Models}}}
      \field{urlday}{3}
      \field{urlmonth}{3}
      \field{urlyear}{2025}
      \field{year}{2022}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/5FGX8IRZ/Wang et al. - 2022 - Self-Consistency Improves Chain of Thought Reasoning in Language Models Slides.pdf;/Users/landes/opt/var/zotero/storage/EWECTD92/Wang et al. - 2022 - Self-Consistency Improves Chain of Thought Reasoning in Language Models.pdf
      \endverb
      \verb{urlraw}
      \verb https://openreview.net/pdf?id=1PL1NIMMrw
      \endverb
      \verb{url}
      \verb https://openreview.net/pdf?id=1PL1NIMMrw
      \endverb
    \endentry
    \entry{sechidisStratificationMultilabelData2011}{incollection}{}
      \name{author}{3}{}{%
        {{hash=ad5a19fa24860e83c0622bf6b9193b36}{%
           family={Sechidis},
           familyi={S\bibinitperiod},
           given={Konstantinos},
           giveni={K\bibinitperiod}}}%
        {{hash=4f0d141cf0fe25aef8af5a28df702ef7}{%
           family={Tsoumakas},
           familyi={T\bibinitperiod},
           given={Grigorios},
           giveni={G\bibinitperiod}}}%
        {{hash=a5f197c3ac3debe11a3bc412d8b5923b}{%
           family={Vlahavas},
           familyi={V\bibinitperiod},
           given={Ioannis},
           giveni={I\bibinitperiod}}}%
      }
      \name{editor}{4}{}{%
        {{hash=a3b0e05489b14b7e94e12640d41a9e3b}{%
           family={Gunopulos},
           familyi={G\bibinitperiod},
           given={Dimitrios},
           giveni={D\bibinitperiod}}}%
        {{hash=ee42cfed2ff3020233d2de97c356eaee}{%
           family={Hofmann},
           familyi={H\bibinitperiod},
           given={Thomas},
           giveni={T\bibinitperiod}}}%
        {{hash=91c6d89aff69b05661903e935a3e0403}{%
           family={Malerba},
           familyi={M\bibinitperiod},
           given={Donato},
           giveni={D\bibinitperiod}}}%
        {{hash=a325a5cf58bcb9d372a4bcab568fc2c5}{%
           family={Vazirgiannis},
           familyi={V\bibinitperiod},
           given={Michalis},
           giveni={M\bibinitperiod}}}%
      }
      \list{location}{1}{%
        {Berlin, Heidelberg}%
      }
      \list{publisher}{1}{%
        {Springer Berlin Heidelberg}%
      }
      \strng{namehash}{891438ab01c40552c4300c632afaa84c}
      \strng{fullhash}{ba94512c201d66edda63e4971aa95e5b}
      \strng{bibnamehash}{ba94512c201d66edda63e4971aa95e5b}
      \strng{authorbibnamehash}{ba94512c201d66edda63e4971aa95e5b}
      \strng{authornamehash}{891438ab01c40552c4300c632afaa84c}
      \strng{authorfullhash}{ba94512c201d66edda63e4971aa95e5b}
      \strng{editorbibnamehash}{37b4835ec48b9e6ea164020c8485890f}
      \strng{editornamehash}{a01ae49d072e08e1979e0c5612ee04be}
      \strng{editorfullhash}{37b4835ec48b9e6ea164020c8485890f}
      \field{sortinit}{5}
      \field{sortinithash}{20e9b4b0b173788c5dace24730f47d8c}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{abstract}{Stratified sampling is a sampling method that takes into account the existence of disjoint groups within a population and produces samples where the proportion of these groups is maintained. In single-label classification tasks, groups are differentiated based on the value of the target variable. In multi-label learning tasks, however, where there are multiple target variables, it is not clear how stratified sampling could/should be performed. This paper investigates stratification in the multi-label data context. It considers two stratification methods for multi-label data and empirically compares them along with random sampling on a number of datasets and based on a number of evaluation criteria. The results reveal some interesting conclusions with respect to the utility of each method for particular types of multi-label datasets.}
      \field{booktitle}{Machine {{Learning}} and {{Knowledge Discovery}} in {{Databases}}}
      \field{isbn}{978-3-642-23807-9 978-3-642-23808-6}
      \field{langid}{english}
      \field{title}{On the {{Stratification}} of {{Multi-label Data}}}
      \field{urlday}{20}
      \field{urlmonth}{3}
      \field{urlyear}{2024}
      \field{volume}{6913}
      \field{year}{2011}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \field{pages}{145\bibrangedash 158}
      \range{pages}{14}
      \verb{doi}
      \verb 10.1007/978-3-642-23808-6_10
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/295PSRL6/Sechidis et al. - 2011 - On the Stratification of Multi-label Data.pdf
      \endverb
      \verb{urlraw}
      \verb http://link.springer.com/10.1007/978-3-642-23808-6_10
      \endverb
      \verb{url}
      \verb http://link.springer.com/10.1007/978-3-642-23808-6_10
      \endverb
    \endentry
    \entry{huLoRALowRankAdaptation2021a}{inproceedings}{}
      \name{author}{8}{}{%
        {{hash=e6a95d07b8ae7f14e4eb777c6980a059}{%
           family={Hu},
           familyi={H\bibinitperiod},
           given={Edward\bibnamedelima J.},
           giveni={E\bibinitperiod\bibinitdelim J\bibinitperiod}}}%
        {{hash=1701c0f05662e92cf52cfc8c16437496}{%
           family={Shen},
           familyi={S\bibinitperiod},
           given={Yelong},
           giveni={Y\bibinitperiod}}}%
        {{hash=ab0fdbc1586103dda7ac5e0852e5b2c3}{%
           family={Wallis},
           familyi={W\bibinitperiod},
           given={Phillip},
           giveni={P\bibinitperiod}}}%
        {{hash=eaa5cc98b7f19b4ce07c832213a13b9d}{%
           family={Allen-Zhu},
           familyi={A\bibinithyphendelim Z\bibinitperiod},
           given={Zeyuan},
           giveni={Z\bibinitperiod}}}%
        {{hash=0d2c91b24f885b22d373a892a768abc8}{%
           family={Li},
           familyi={L\bibinitperiod},
           given={Yuanzhi},
           giveni={Y\bibinitperiod}}}%
        {{hash=b654b88ecd4c3ff1ea29da275bce701c}{%
           family={Wang},
           familyi={W\bibinitperiod},
           given={Shean},
           giveni={S\bibinitperiod}}}%
        {{hash=55f210233ac686af68eba11a97bd84e2}{%
           family={Wang},
           familyi={W\bibinitperiod},
           given={Lu},
           giveni={L\bibinitperiod}}}%
        {{hash=05d71a9c5e7ac79222e01a55af0ccb93}{%
           family={Chen},
           familyi={C\bibinitperiod},
           given={Weizhu},
           giveni={W\bibinitperiod}}}%
      }
      \strng{namehash}{d775178c34083951ab1e07df578582c3}
      \strng{fullhash}{08f4b49735d5d145be00bc9c07f38975}
      \strng{bibnamehash}{d775178c34083951ab1e07df578582c3}
      \strng{authorbibnamehash}{d775178c34083951ab1e07df578582c3}
      \strng{authornamehash}{d775178c34083951ab1e07df578582c3}
      \strng{authorfullhash}{08f4b49735d5d145be00bc9c07f38975}
      \field{sortinit}{6}
      \field{sortinithash}{b33bc299efb3c36abec520a4c896a66d}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{shorttitle}
      \field{abstract}{An important paradigm of natural language processing consists of large-scale pre-training on general domain data and adaptation to particular tasks or domains. As we pre-train larger models, full fine-tuning, which retrains all model parameters, becomes less feasible. Using GPT-3 175B as an example -- deploying independent instances of fine-tuned models, each with 175B parameters, is prohibitively expensive. We propose Low-Rank Adaptation, or LoRA, which freezes the pre-trained model weights and injects trainable rank decomposition matrices into each layer of the Transformer architecture, greatly reducing the number of trainable parameters for downstream tasks. Compared to GPT-3 175B fine-tuned with Adam, LoRA can reduce the number of trainable parameters by a factor of 10,000 and the GPU memory requirement by a factor of 3. LoRA performs on-par or better than fine-tuning in model quality on RoBERTa, DeBERTa, GPT-2, and GPT-3, despite having fewer trainable parameters, a higher training throughput, and, unlike adapters, no additional inference latency. We also provide an empirical investigation into rank-deficiency in language model adaptation, which sheds light on the efficacy of LoRA. We release a package that facilitates the integration of LoRA with PyTorch models and provide our implementations and model checkpoints for RoBERTa, DeBERTa, and GPT-2 at https://github.com/microsoft/LoRA.}
      \field{day}{6}
      \field{eventtitle}{International {{Conference}} on {{Learning Representations}}}
      \field{langid}{english}
      \field{month}{10}
      \field{shorttitle}{{{LoRA}}}
      \field{title}{{{LoRA}}: {{Low-Rank Adaptation}} of {{Large Language Models}}}
      \field{urlday}{24}
      \field{urlmonth}{1}
      \field{urlyear}{2025}
      \field{year}{2021}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/T35PHX5Q/Hu et al. - 2021 - LoRA Low-Rank Adaptation of Large Language Models.pdf
      \endverb
      \verb{urlraw}
      \verb https://openreview.net/forum?id=nZeVKeeFYf9
      \endverb
      \verb{url}
      \verb https://openreview.net/forum?id=nZeVKeeFYf9
      \endverb
    \endentry
    \entry{aghajanyanIntrinsicDimensionalityExplains2021}{inproceedings}{}
      \name{author}{3}{}{%
        {{hash=f7b92d087e7f9a78f52107b58c9297c0}{%
           family={Aghajanyan},
           familyi={A\bibinitperiod},
           given={Armen},
           giveni={A\bibinitperiod}}}%
        {{hash=545cf31b67044795c5772570c35f71f0}{%
           family={Gupta},
           familyi={G\bibinitperiod},
           given={Sonal},
           giveni={S\bibinitperiod}}}%
        {{hash=1dbd3a5b42828fb2cebd7786488ba425}{%
           family={Zettlemoyer},
           familyi={Z\bibinitperiod},
           given={Luke},
           giveni={L\bibinitperiod}}}%
      }
      \name{editor}{4}{}{%
        {{hash=9d8c366afd7f948820f05d7fe6206c28}{%
           family={Zong},
           familyi={Z\bibinitperiod},
           given={Chengqing},
           giveni={C\bibinitperiod}}}%
        {{hash=61e00ed0c44b8bddb9077a74a4ac1167}{%
           family={Xia},
           familyi={X\bibinitperiod},
           given={Fei},
           giveni={F\bibinitperiod}}}%
        {{hash=318a797cfb1e6f8da35b79287d226780}{%
           family={Li},
           familyi={L\bibinitperiod},
           given={Wenjie},
           giveni={W\bibinitperiod}}}%
        {{hash=6fe24dce481a67e247581d4b20435709}{%
           family={Navigli},
           familyi={N\bibinitperiod},
           given={Roberto},
           giveni={R\bibinitperiod}}}%
      }
      \list{location}{1}{%
        {Online}%
      }
      \list{publisher}{1}{%
        {Association for Computational Linguistics}%
      }
      \strng{namehash}{883b8672233d92d7b5055910f6f593f8}
      \strng{fullhash}{aff1845554e51b4987c266a079849a2b}
      \strng{bibnamehash}{aff1845554e51b4987c266a079849a2b}
      \strng{authorbibnamehash}{aff1845554e51b4987c266a079849a2b}
      \strng{authornamehash}{883b8672233d92d7b5055910f6f593f8}
      \strng{authorfullhash}{aff1845554e51b4987c266a079849a2b}
      \strng{editorbibnamehash}{7c3dda83a9d34ca480a8d30a423f8916}
      \strng{editornamehash}{4058c5286e5d51b02c73d306e7a9473d}
      \strng{editorfullhash}{7c3dda83a9d34ca480a8d30a423f8916}
      \field{sortinit}{6}
      \field{sortinithash}{b33bc299efb3c36abec520a4c896a66d}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{abstract}{Although pretrained language models can be fine-tuned to produce state-of-the-art results for a very wide range of language understanding tasks, the dynamics of this process are not well understood, especially in the low data regime. Why can we use relatively vanilla gradient descent algorithms (e.g., without strong regularization) to tune a model with hundreds of millions of parameters on datasets with only hundreds or thousands of labeled examples? In this paper, we argue that analyzing fine-tuning through the lens of intrinsic dimension provides us with empirical and theoretical intuitions to explain this remarkable phenomenon. We empirically show that common pre-trained models have a very low intrinsic dimension; in other words, there exists a low dimension reparameterization that is as effective for fine-tuning as the full parameter space. For example, by optimizing only 200 trainable parameters randomly projected back into the full space, we can tune a RoBERTa model to achieve 90\% of the full parameter performance levels on MRPC. Furthermore, we empirically show that pre-training implicitly minimizes intrinsic dimension and, perhaps surprisingly, larger models tend to have lower intrinsic dimension after a fixed number of pre-training updates, at least in part explaining their extreme effectiveness. Lastly, we connect intrinsic dimensionality with low dimensional task representations and compression based generalization bounds to provide intrinsic-dimension-based generalization bounds that are independent of the full parameter count.}
      \field{booktitle}{Proceedings of the 59th {{Annual Meeting}} of the {{Association}} for {{Computational Linguistics}} and the 11th {{International Joint Conference}} on {{Natural Language Processing}} ({{Volume}} 1: {{Long Papers}})}
      \field{eventtitle}{{{ACL-IJCNLP}} 2021}
      \field{month}{8}
      \field{title}{Intrinsic {{Dimensionality Explains}} the {{Effectiveness}} of {{Language Model Fine-Tuning}}}
      \field{urlday}{24}
      \field{urlmonth}{1}
      \field{urlyear}{2025}
      \field{year}{2021}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \field{pages}{7319\bibrangedash 7328}
      \range{pages}{10}
      \verb{doi}
      \verb 10.18653/v1/2021.acl-long.568
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/YSW6QCLP/Aghajanyan et al. - 2021 - Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuning.pdf
      \endverb
      \verb{urlraw}
      \verb https://aclanthology.org/2021.acl-long.568/
      \endverb
      \verb{url}
      \verb https://aclanthology.org/2021.acl-long.568/
      \endverb
    \endentry
    \entry{kanayamaIncorporatingSyntaxLexical2024}{inproceedings}{}
      \name{author}{4}{}{%
        {{hash=55663b9b52c59f45f68a6091921b1323}{%
           family={Kanayama},
           familyi={K\bibinitperiod},
           given={Hiroshi},
           giveni={H\bibinitperiod}}}%
        {{hash=f0e7d180081df6c4c59c600f7c044474}{%
           family={Zhao},
           familyi={Z\bibinitperiod},
           given={Yang},
           giveni={Y\bibinitperiod}}}%
        {{hash=6c206c35b8d1cb0c8097bbe40c904cb9}{%
           family={Iwamoto},
           familyi={I\bibinitperiod},
           given={Ran},
           giveni={R\bibinitperiod}}}%
        {{hash=c0b859b764270e6460bea65f56c6d04b}{%
           family={Ohko},
           familyi={O\bibinitperiod},
           given={Takuya},
           giveni={T\bibinitperiod}}}%
      }
      \list{location}{2}{%
        {Bangkok, Thailand}%
        {virtual meeting}%
      }
      \list{publisher}{1}{%
        {Association for Computational Linguistics}%
      }
      \strng{namehash}{e5098c3314a7a9ae69a20cf16deeb6c2}
      \strng{fullhash}{d5feb189a4d3fcb3ced0dcdf939e0475}
      \strng{bibnamehash}{d5feb189a4d3fcb3ced0dcdf939e0475}
      \strng{authorbibnamehash}{d5feb189a4d3fcb3ced0dcdf939e0475}
      \strng{authornamehash}{e5098c3314a7a9ae69a20cf16deeb6c2}
      \strng{authorfullhash}{d5feb189a4d3fcb3ced0dcdf939e0475}
      \field{sortinit}{6}
      \field{sortinithash}{b33bc299efb3c36abec520a4c896a66d}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{abstract}{This paper exploits a sentiment extractor supported by syntactic and lexical resources to enhance multilingual sentiment classification solved through the generative approach, without retraining LLMs. By adding external information of words and phrases that have positive/negative polarities, the multilingual sentiment classification error was reduced by up to 33 points, and the combination of two approaches performed best especially in highperforming pairs of LLMs and languages.}
      \field{booktitle}{Findings of the {{Association}} for {{Computational Linguistics ACL}} 2024}
      \field{eventtitle}{Findings of the {{Association}} for {{Computational Linguistics ACL}} 2024}
      \field{langid}{english}
      \field{title}{Incorporating {{Syntax}} and {{Lexical Knowledge}} to {{Multilingual Sentiment Classification}} on {{Large Language Models}}}
      \field{urlday}{12}
      \field{urlmonth}{2}
      \field{urlyear}{2025}
      \field{year}{2024}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \field{pages}{4810\bibrangedash 4817}
      \range{pages}{8}
      \verb{doi}
      \verb 10.18653/v1/2024.findings-acl.286
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/72VYAZK2/Kanayama et al. - 2024 - Incorporating Syntax and Lexical Knowledge to Multilingual Sentiment Classification on Large Languag.pdf
      \endverb
      \verb{urlraw}
      \verb https://aclanthology.org/2024.findings-acl.286
      \endverb
      \verb{url}
      \verb https://aclanthology.org/2024.findings-acl.286
      \endverb
    \endentry
    \entry{liuRoBERTaRobustlyOptimized2019}{misc}{}
      \name{author}{10}{}{%
        {{hash=94530daf7a9db4abe89cfb22935373eb}{%
           family={Liu},
           familyi={L\bibinitperiod},
           given={Yinhan},
           giveni={Y\bibinitperiod}}}%
        {{hash=b13aa2bad5258fa5ef7a733f2d305a49}{%
           family={Ott},
           familyi={O\bibinitperiod},
           given={Myle},
           giveni={M\bibinitperiod}}}%
        {{hash=78a420900f50a8470ad085fb05231bf6}{%
           family={Goyal},
           familyi={G\bibinitperiod},
           given={Naman},
           giveni={N\bibinitperiod}}}%
        {{hash=e483b52ce2cd3ba2fd08e7bf4fef4ff0}{%
           family={Du},
           familyi={D\bibinitperiod},
           given={Jingfei},
           giveni={J\bibinitperiod}}}%
        {{hash=e5bfa941bcdbfecb5f3e42bb6ac9eb5f}{%
           family={Joshi},
           familyi={J\bibinitperiod},
           given={Mandar},
           giveni={M\bibinitperiod}}}%
        {{hash=aed188db3fc6855ac5666aa14e04a3bb}{%
           family={Chen},
           familyi={C\bibinitperiod},
           given={Danqi},
           giveni={D\bibinitperiod}}}%
        {{hash=038965e189161e03f6255a4278c280a1}{%
           family={Levy},
           familyi={L\bibinitperiod},
           given={Omer},
           giveni={O\bibinitperiod}}}%
        {{hash=c97f53fdeeb04c28de19e3324cb4bc0a}{%
           family={Lewis},
           familyi={L\bibinitperiod},
           given={Mike},
           giveni={M\bibinitperiod}}}%
        {{hash=1dbd3a5b42828fb2cebd7786488ba425}{%
           family={Zettlemoyer},
           familyi={Z\bibinitperiod},
           given={Luke},
           giveni={L\bibinitperiod}}}%
        {{hash=9b97236dd2d1a104fc5cf9660dd5582e}{%
           family={Stoyanov},
           familyi={S\bibinitperiod},
           given={Veselin},
           giveni={V\bibinitperiod}}}%
      }
      \strng{namehash}{bbac34a28b7aba5cd543f7c72e0d987d}
      \strng{fullhash}{7579c765ce38b2c34c8f9768ec3bc342}
      \strng{bibnamehash}{bbac34a28b7aba5cd543f7c72e0d987d}
      \strng{authorbibnamehash}{bbac34a28b7aba5cd543f7c72e0d987d}
      \strng{authornamehash}{bbac34a28b7aba5cd543f7c72e0d987d}
      \strng{authorfullhash}{7579c765ce38b2c34c8f9768ec3bc342}
      \field{sortinit}{6}
      \field{sortinithash}{b33bc299efb3c36abec520a4c896a66d}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{shorttitle}
      \field{abstract}{Language model pretraining has led to significant performance gains but careful comparison between different approaches is challenging. Training is computationally expensive, often done on private datasets of different sizes, and, as we will show, hyperparameter choices have significant impact on the final results. We present a replication study of BERT pretraining (Devlin et al., 2019) that carefully measures the impact of many key hyperparameters and training data size. We find that BERT was significantly undertrained, and can match or exceed the performance of every model published after it. Our best model achieves state-of-the-art results on GLUE, RACE and SQuAD. These results highlight the importance of previously overlooked design choices, and raise questions about the source of recently reported improvements. We release our models and code.}
      \field{day}{26}
      \field{eprintclass}{cs}
      \field{eprinttype}{arXiv}
      \field{howpublished}{arXiv: 1907.11692 (Only available as arXiv preprint)}
      \field{month}{7}
      \field{shorttitle}{{{RoBERTa}}}
      \field{title}{{{RoBERTa}}: {{A Robustly Optimized BERT Pretraining Approach}}}
      \field{urlday}{24}
      \field{urlmonth}{6}
      \field{urlyear}{2021}
      \field{year}{2019}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \verb{eprint}
      \verb 1907.11692
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/P2MV4DQB/Liu et al. - 2019 - RoBERTa A Robustly Optimized BERT Pretraining App.pdf;/Users/landes/opt/var/zotero/storage/2GJRHQLI/1907.html
      \endverb
      \verb{urlraw}
      \verb http://arxiv.org/abs/1907.11692
      \endverb
      \verb{url}
      \verb http://arxiv.org/abs/1907.11692
      \endverb
      \keyw{Computer Science - Computation and Language}
    \endentry
    \entry{montaniExplosionSpaCyV3722023}{software}{}
      \name{author}{6}{}{%
        {{hash=47c9fa7dcc4eb3484a88f4bb42655895}{%
           family={Montani},
           familyi={M\bibinitperiod},
           given={Ines},
           giveni={I\bibinitperiod}}}%
        {{hash=31cf0cd70714219d39b46b0f8aae95f9}{%
           family={Honnibal},
           familyi={H\bibinitperiod},
           given={Matthew},
           giveni={M\bibinitperiod}}}%
        {{hash=31cf0cd70714219d39b46b0f8aae95f9}{%
           family={Honnibal},
           familyi={H\bibinitperiod},
           given={Matthew},
           giveni={M\bibinitperiod}}}%
        {{hash=536eccdf07a1897181ba997c05a422d4}{%
           family={Boyd},
           familyi={B\bibinitperiod},
           given={Adriane},
           giveni={A\bibinitperiod}}}%
        {{hash=53ed9c382136c29aab695a2f663001a0}{%
           family={Landeghem},
           familyi={L\bibinitperiod},
           given={Sofie\bibnamedelima Van},
           giveni={S\bibinitperiod\bibinitdelim V\bibinitperiod}}}%
        {{hash=0170a06ea692c40122ad0e00860c120e}{%
           family={Peters},
           familyi={P\bibinitperiod},
           given={Henning},
           giveni={H\bibinitperiod}}}%
      }
      \list{organization}{1}{%
        {Zenodo}%
      }
      \strng{namehash}{7affdf13b3125b4ad8c38fc756783180}
      \strng{fullhash}{7be19e89c2de0cd035626311e2e97790}
      \strng{bibnamehash}{7affdf13b3125b4ad8c38fc756783180}
      \strng{authorbibnamehash}{7affdf13b3125b4ad8c38fc756783180}
      \strng{authornamehash}{7affdf13b3125b4ad8c38fc756783180}
      \strng{authorfullhash}{7be19e89c2de0cd035626311e2e97790}
      \field{sortinit}{6}
      \field{sortinithash}{b33bc299efb3c36abec520a4c896a66d}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{shorttitle}
      \field{abstract}{✨ New features and improvements Update \_\_all\_\_ fields (\#13063). 🔴 Bug fixes \#13035: Remove Pathy requirement. \#13053: Restore spacy.cli.project API. \#13057: Support Any comparisons for Token and Span. 📖 Documentation and examples Many updates for spacy-llm including Azure OpenAI, PaLM, and Mistral support. Various documentation corrections. 👥 Contributors @adrianeboyd, @honnibal, @ines, @rmitsch, @svlandeg}
      \field{day}{16}
      \field{month}{10}
      \field{shorttitle}{Explosion/{{spaCy}}}
      \field{title}{Explosion/{{spaCy}}: V3.7.2: {{Fixes}} for {{APIs}} and Requirements}
      \field{urlday}{21}
      \field{urlmonth}{3}
      \field{urlyear}{2025}
      \field{version}{v3.7.2}
      \field{year}{2023}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \verb{doi}
      \verb 10.5281/zenodo.10009823
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/G6BSCU9D/10009823.html
      \endverb
      \verb{urlraw}
      \verb https://zenodo.org/records/10009823
      \endverb
      \verb{url}
      \verb https://zenodo.org/records/10009823
      \endverb
    \endentry
    \entry{neumannScispaCyFastRobust2019}{inproceedings}{}
      \name{author}{4}{}{%
        {{hash=93f95e4f65833691b9a15cbe2791e2df}{%
           family={Neumann},
           familyi={N\bibinitperiod},
           given={Mark},
           giveni={M\bibinitperiod}}}%
        {{hash=794e369f15e51ab4d928f7d736f5d9d1}{%
           family={King},
           familyi={K\bibinitperiod},
           given={Daniel},
           giveni={D\bibinitperiod}}}%
        {{hash=ad932527c4d078ff96e5f0b189c66c61}{%
           family={Beltagy},
           familyi={B\bibinitperiod},
           given={Iz},
           giveni={I\bibinitperiod}}}%
        {{hash=457d1a8416f68e512111e2072e02b9eb}{%
           family={Ammar},
           familyi={A\bibinitperiod},
           given={Waleed},
           giveni={W\bibinitperiod}}}%
      }
      \list{location}{1}{%
        {Florence, Italy}%
      }
      \list{publisher}{1}{%
        {Association for Computational Linguistics}%
      }
      \strng{namehash}{0d6196ef887ec04b78560e7226d8863c}
      \strng{fullhash}{e3749eaace5f848458d81ae0c1cc731e}
      \strng{bibnamehash}{e3749eaace5f848458d81ae0c1cc731e}
      \strng{authorbibnamehash}{e3749eaace5f848458d81ae0c1cc731e}
      \strng{authornamehash}{0d6196ef887ec04b78560e7226d8863c}
      \strng{authorfullhash}{e3749eaace5f848458d81ae0c1cc731e}
      \field{sortinit}{6}
      \field{sortinithash}{b33bc299efb3c36abec520a4c896a66d}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{shorttitle}
      \field{abstract}{Despite recent advances in natural language processing, many statistical models for processing text perform extremely poorly under domain shift. Processing biomedical and clinical text is a critically important application area of natural language processing, for which there are few robust, practical, publicly available models. This paper describes scispaCy, a new Python library and models for practical biomedical/scientific text processing, which heavily leverages the spaCy library. We detail the performance of two packages of models released in scispaCy and demonstrate their robustness on several tasks and datasets. Models and code are available at https:// allenai.github.io/scispacy/.}
      \field{booktitle}{Proceedings of the 18th {{BioNLP Workshop}} and {{Shared Task}}}
      \field{eventtitle}{Proceedings of the 18th {{BioNLP Workshop}} and {{Shared Task}}}
      \field{langid}{english}
      \field{shorttitle}{{{ScispaCy}}}
      \field{title}{{{ScispaCy}}: {{Fast}} and {{Robust Models}} for {{Biomedical Natural Language Processing}}}
      \field{urlday}{2}
      \field{urlmonth}{8}
      \field{urlyear}{2021}
      \field{year}{2019}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \field{pages}{319\bibrangedash 327}
      \range{pages}{9}
      \verb{doi}
      \verb 10.18653/v1/W19-5034
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/GIN44UZG/Neumann et al. - 2019 - ScispaCy Fast and Robust Models for Biomedical Na.pdf
      \endverb
      \verb{urlraw}
      \verb https://www.aclweb.org/anthology/W19-5034
      \endverb
      \verb{url}
      \verb https://www.aclweb.org/anthology/W19-5034
      \endverb
    \endentry
    \entry{bodenreiderUnifiedMedicalLanguage2004}{article}{}
      \name{author}{1}{}{%
        {{hash=0bd9aac096a3ead0e9ea30128cb48c46}{%
           family={Bodenreider},
           familyi={B\bibinitperiod},
           given={Olivier},
           giveni={O\bibinitperiod}}}%
      }
      \strng{namehash}{0bd9aac096a3ead0e9ea30128cb48c46}
      \strng{fullhash}{0bd9aac096a3ead0e9ea30128cb48c46}
      \strng{bibnamehash}{0bd9aac096a3ead0e9ea30128cb48c46}
      \strng{authorbibnamehash}{0bd9aac096a3ead0e9ea30128cb48c46}
      \strng{authornamehash}{0bd9aac096a3ead0e9ea30128cb48c46}
      \strng{authorfullhash}{0bd9aac096a3ead0e9ea30128cb48c46}
      \field{sortinit}{7}
      \field{sortinithash}{108d0be1b1bee9773a1173443802c0a3}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{shorttitle}
      \field{abstract}{The Unified Medical Language System ( http://umlsks.nlm.nih.gov ) is a repository of biomedical vocabularies developed by the US National Library of Medicine. The UMLS integrates over 2 million names for some 900 000 concepts from more than 60 families of biomedical vocabularies, as well as 12 million relations among these concepts. Vocabularies integrated in the UMLS Metathesaurus include the NCBI taxonomy, Gene Ontology, the Medical Subject Headings (MeSH), OMIM and the Digital Anatomist Symbolic Knowledge Base. UMLS concepts are not only inter‐related, but may also be linked to external resources such as GenBank. In addition to data, the UMLS includes tools for customizing the Metathesaurus (MetamorphoSys), for generating lexical variants of concept names (lvg) and for extracting UMLS concepts from text (MetaMap). The UMLS knowledge sources are updated quarterly. All vocabularies are available at no fee for research purposes within an institution, but UMLS users are required to sign a license agreement. The UMLS knowledge sources are distributed on CD‐ROM and by FTP.}
      \field{day}{1}
      \field{issn}{0305-1048}
      \field{issue}{suppl\_1}
      \field{journaltitle}{Nucleic Acids Research}
      \field{month}{1}
      \field{shortjournal}{Nucleic Acids Research}
      \field{shorttitle}{The {{Unified Medical Language System}} ({{UMLS}})}
      \field{title}{The {{Unified Medical Language System}} ({{UMLS}}): Integrating Biomedical Terminology}
      \field{urlday}{1}
      \field{urlmonth}{10}
      \field{urlyear}{2021}
      \field{volume}{32}
      \field{year}{2004}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \field{pages}{D267\bibrangedash D270}
      \range{pages}{-1}
      \verb{doi}
      \verb 10.1093/nar/gkh061
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/YWB3UPRY/Bodenreider - 2004 - The Unified Medical Language System (UMLS) integr.pdf;/Users/landes/opt/var/zotero/storage/ADXLIRR8/2505235.html
      \endverb
      \verb{urlraw}
      \verb https://doi.org/10.1093/nar/gkh061
      \endverb
      \verb{url}
      \verb https://doi.org/10.1093/nar/gkh061
      \endverb
    \endentry
    \entry{beamClinicalConceptEmbeddings2020}{article}{}
      \name{author}{9}{}{%
        {{hash=3333cfe95922b8f5d8bac7127e304455}{%
           family={Beam},
           familyi={B\bibinitperiod},
           given={Andrew\bibnamedelima L.},
           giveni={A\bibinitperiod\bibinitdelim L\bibinitperiod}}}%
        {{hash=81b5825980fce2808257a1af8cf24dfd}{%
           family={Kompa},
           familyi={K\bibinitperiod},
           given={Benjamin},
           giveni={B\bibinitperiod}}}%
        {{hash=77cc1e5e1e0bc4f384d726c00f979431}{%
           family={Schmaltz},
           familyi={S\bibinitperiod},
           given={Allen},
           giveni={A\bibinitperiod}}}%
        {{hash=f4cdaa0a40cf87104b9919a709806f7b}{%
           family={Fried},
           familyi={F\bibinitperiod},
           given={Inbar},
           giveni={I\bibinitperiod}}}%
        {{hash=354528270dae01ae482e3afbb64658f5}{%
           family={Weber},
           familyi={W\bibinitperiod},
           given={Griffin},
           giveni={G\bibinitperiod}}}%
        {{hash=db8ded231ae00be5e5eed437df809c7a}{%
           family={Palmer},
           familyi={P\bibinitperiod},
           given={Nathan},
           giveni={N\bibinitperiod}}}%
        {{hash=cb40708914697ee047c3a5ff66fc005b}{%
           family={Shi},
           familyi={S\bibinitperiod},
           given={Xu},
           giveni={X\bibinitperiod}}}%
        {{hash=1df414765f32cd3fb95f7ca80bfb5b56}{%
           family={Cai},
           familyi={C\bibinitperiod},
           given={Tianxi},
           giveni={T\bibinitperiod}}}%
        {{hash=7d569ca862abfbea5bb908a4fd1990f5}{%
           family={Kohane},
           familyi={K\bibinitperiod},
           given={Isaac\bibnamedelima S.},
           giveni={I\bibinitperiod\bibinitdelim S\bibinitperiod}}}%
      }
      \strng{namehash}{f9bd91dcf126e3dfb6e341a83860a1c7}
      \strng{fullhash}{8275fc48484c8d8a3003ef3632f66611}
      \strng{bibnamehash}{f9bd91dcf126e3dfb6e341a83860a1c7}
      \strng{authorbibnamehash}{f9bd91dcf126e3dfb6e341a83860a1c7}
      \strng{authornamehash}{f9bd91dcf126e3dfb6e341a83860a1c7}
      \strng{authorfullhash}{8275fc48484c8d8a3003ef3632f66611}
      \field{sortinit}{8}
      \field{sortinithash}{a231b008ebf0ecbe0b4d96dcc159445f}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{abstract}{Word embeddings are a popular approach to unsupervised learning of word relationships that are widely used in natural language processing. In this article, we present a new set of embeddings for medical concepts learned using an extremely large collection of multimodal medical data. Leaning on recent theoretical insights, we demonstrate how an insurance claims database of 60 million members, a collection of 20 million clinical notes, and 1.7 million full text biomedical journal articles can be combined to embed concepts into a common space, resulting in the largest ever set of embeddings for 108,477 medical concepts. To evaluate our approach, we present a new benchmark methodology based on statistical power specifically designed to test embeddings of medical concepts. Our approach, called cui2vec, attains state-of-the-art performance relative to previous methods in most instances. Finally, we provide a downloadable set of pre-trained embeddings for other researchers to use, as well as an online tool for interactive exploration of the cui2vec embeddings.}
      \field{eprinttype}{pubmed}
      \field{issn}{2335-6936}
      \field{journaltitle}{Pacific Symposium on Biocomputing. Pacific Symposium on Biocomputing}
      \field{langid}{english}
      \field{shortjournal}{Pac Symp Biocomput}
      \field{title}{Clinical {{Concept Embeddings Learned}} from {{Massive Sources}} of {{Multimodal Medical Data}}}
      \field{volume}{25}
      \field{year}{2020}
      \field{dateera}{ce}
      \field{pages}{295\bibrangedash 306}
      \range{pages}{12}
      \verb{doi}
      \verb 10.1142/9789811215636_0027
      \endverb
      \verb{eprint}
      \verb 31797605
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/8MNQ476K/Beam et al. - 2019 - Clinical Concept Embeddings Learned from Massive S.pdf;/Users/landes/opt/var/zotero/storage/NQQT4BMF/vignette.html
      \endverb
      \keyw{Computer Science - Artificial Intelligence,Computer Science - Computation and Language,Statistics - Machine Learning}
    \endentry
    \entry{mikolovEfficientEstimationWord2013}{misc}{}
      \name{author}{4}{}{%
        {{hash=a2d359b12ca2fadf0b40136a73f021bb}{%
           family={Mikolov},
           familyi={M\bibinitperiod},
           given={Tomas},
           giveni={T\bibinitperiod}}}%
        {{hash=ee3f7d7b96add98106db907e189d6c13}{%
           family={Chen},
           familyi={C\bibinitperiod},
           given={Kai},
           giveni={K\bibinitperiod}}}%
        {{hash=3d11e6f2a0d0a1183b2cf62996525afc}{%
           family={Corrado},
           familyi={C\bibinitperiod},
           given={Greg},
           giveni={G\bibinitperiod}}}%
        {{hash=4aecfb0cc2e1e3b7899129fa2a94e2b8}{%
           family={Dean},
           familyi={D\bibinitperiod},
           given={Jeffrey},
           giveni={J\bibinitperiod}}}%
      }
      \strng{namehash}{d4849f6d57e38d9b9846cfb360e45131}
      \strng{fullhash}{f24c60896b6daa69474b40efb61f4e88}
      \strng{bibnamehash}{f24c60896b6daa69474b40efb61f4e88}
      \strng{authorbibnamehash}{f24c60896b6daa69474b40efb61f4e88}
      \strng{authornamehash}{d4849f6d57e38d9b9846cfb360e45131}
      \strng{authorfullhash}{f24c60896b6daa69474b40efb61f4e88}
      \field{extraname}{1}
      \field{sortinit}{8}
      \field{sortinithash}{a231b008ebf0ecbe0b4d96dcc159445f}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{eprinttype}{arXiv}
      \field{howpublished}{arXiv: 1301.3781 (Only available as arXiv preprint)}
      \field{pubstate}{prepublished}
      \field{title}{Efficient Estimation of Word Representations in Vector Space}
      \field{year}{2013}
      \field{dateera}{ce}
      \verb{eprint}
      \verb 1301.3781
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/9ADZ2JFK/Mikolov et al. - 2013 - Efficient estimation of word representations in ve.pdf
      \endverb
    \endentry
    \entry{mikolovDistributedRepresentationsWords2013}{inproceedings}{}
      \name{author}{5}{}{%
        {{hash=a2d359b12ca2fadf0b40136a73f021bb}{%
           family={Mikolov},
           familyi={M\bibinitperiod},
           given={Tomas},
           giveni={T\bibinitperiod}}}%
        {{hash=8d569d1d5b8b5a7836017a98b430f959}{%
           family={Sutskever},
           familyi={S\bibinitperiod},
           given={Ilya},
           giveni={I\bibinitperiod}}}%
        {{hash=ee3f7d7b96add98106db907e189d6c13}{%
           family={Chen},
           familyi={C\bibinitperiod},
           given={Kai},
           giveni={K\bibinitperiod}}}%
        {{hash=84d9f354fa0b45dae996f27dad2c6607}{%
           family={Corrado},
           familyi={C\bibinitperiod},
           given={Greg\bibnamedelima S},
           giveni={G\bibinitperiod\bibinitdelim S\bibinitperiod}}}%
        {{hash=62f954323339abeba6c6a240e9d2855b}{%
           family={Dean},
           familyi={D\bibinitperiod},
           given={Jeff},
           giveni={J\bibinitperiod}}}%
      }
      \list{publisher}{1}{%
        {Curran Associates, Inc.}%
      }
      \strng{namehash}{d4849f6d57e38d9b9846cfb360e45131}
      \strng{fullhash}{fde8281f0504852db8650bb0736061b6}
      \strng{bibnamehash}{fde8281f0504852db8650bb0736061b6}
      \strng{authorbibnamehash}{fde8281f0504852db8650bb0736061b6}
      \strng{authornamehash}{d4849f6d57e38d9b9846cfb360e45131}
      \strng{authorfullhash}{fde8281f0504852db8650bb0736061b6}
      \field{extraname}{2}
      \field{sortinit}{8}
      \field{sortinithash}{a231b008ebf0ecbe0b4d96dcc159445f}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{abstract}{The recently introduced continuous Skip-gram model is an efficient method for learning high-quality distributed vector representations that capture a large number of precise syntactic and semantic word relationships. In this paper we present several improvements that make the Skip-gram model more expressive and enable it to learn higher quality vectors more rapidly. We show that by subsampling frequent words we obtain significant speedup, and also learn higher quality representations as measured by our tasks. We also introduce Negative Sampling, a simplified variant of Noise Contrastive Estimation (NCE) that learns more accurate vectors for frequent words compared to the hierarchical softmax. An inherent limitation of word representations is their indifference to word order and their inability to represent idiomatic phrases. For example, the meanings of Canada'' and "Air'' cannot be easily combined to obtain "Air Canada''. Motivated by this example, we present a simple and efficient method for finding phrases, and show that their vector representations can be accurately learned by the Skip-gram model. "}
      \field{booktitle}{Advances in {{Neural Information Processing Systems}}}
      \field{title}{Distributed {{Representations}} of {{Words}} and {{Phrases}} and Their {{Compositionality}}}
      \field{urlday}{9}
      \field{urlmonth}{9}
      \field{urlyear}{2022}
      \field{volume}{26}
      \field{year}{2013}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/9JZCE88A/Mikolov et al. - 2013 - Distributed Representations of Words and Phrases a.pdf
      \endverb
      \verb{urlraw}
      \verb https://proceedings.neurips.cc/paper/2013/hash/9aa42b31882ec039965f3c4923ce901b-Abstract.html
      \endverb
      \verb{url}
      \verb https://proceedings.neurips.cc/paper/2013/hash/9aa42b31882ec039965f3c4923ce901b-Abstract.html
      \endverb
    \endentry
    \entry{kraljevicMultidomainClinicalNatural2021}{article}{}
      \name{author}{18}{}{%
        {{hash=50d14fe5e2d8aff6725c7b323744e214}{%
           family={Kraljevic},
           familyi={K\bibinitperiod},
           given={Zeljko},
           giveni={Z\bibinitperiod}}}%
        {{hash=c52f95d586b81fc9893ec0375db2721a}{%
           family={Searle},
           familyi={S\bibinitperiod},
           given={Thomas},
           giveni={T\bibinitperiod}}}%
        {{hash=febb6d83483a0a33315f559966522f09}{%
           family={Shek},
           familyi={S\bibinitperiod},
           given={Anthony},
           giveni={A\bibinitperiod}}}%
        {{hash=0f0b7baa52339ec5550da275bb3e7a60}{%
           family={Roguski},
           familyi={R\bibinitperiod},
           given={Lukasz},
           giveni={L\bibinitperiod}}}%
        {{hash=8236053c2bed25a53a21c286baaa5317}{%
           family={Noor},
           familyi={N\bibinitperiod},
           given={Kawsar},
           giveni={K\bibinitperiod}}}%
        {{hash=dec96ae79dea2bd3795abbecb07c7f22}{%
           family={Bean},
           familyi={B\bibinitperiod},
           given={Daniel},
           giveni={D\bibinitperiod}}}%
        {{hash=e3ccfffd926b7fa947732510b6aebc21}{%
           family={Mascio},
           familyi={M\bibinitperiod},
           given={Aurelie},
           giveni={A\bibinitperiod}}}%
        {{hash=93faf54b57db12f4644678edf05999c1}{%
           family={Zhu},
           familyi={Z\bibinitperiod},
           given={Leilei},
           giveni={L\bibinitperiod}}}%
        {{hash=64c707e0c9a58d189829d3409e96501c}{%
           family={Folarin},
           familyi={F\bibinitperiod},
           given={Amos\bibnamedelima A.},
           giveni={A\bibinitperiod\bibinitdelim A\bibinitperiod}}}%
        {{hash=ea2aaa2f39bc5680e5befb501d02bb96}{%
           family={Roberts},
           familyi={R\bibinitperiod},
           given={Angus},
           giveni={A\bibinitperiod}}}%
        {{hash=759be7b90dcd7f87150525c8a2eac42b}{%
           family={Bendayan},
           familyi={B\bibinitperiod},
           given={Rebecca},
           giveni={R\bibinitperiod}}}%
        {{hash=60cfdb629dcdf0a025356afdfe931450}{%
           family={Richardson},
           familyi={R\bibinitperiod},
           given={Mark\bibnamedelima P.},
           giveni={M\bibinitperiod\bibinitdelim P\bibinitperiod}}}%
        {{hash=1af97348528887ff8aef36bd7e760639}{%
           family={Stewart},
           familyi={S\bibinitperiod},
           given={Robert},
           giveni={R\bibinitperiod}}}%
        {{hash=04430dd2c14f88763b98101422a93d06}{%
           family={Shah},
           familyi={S\bibinitperiod},
           given={Anoop\bibnamedelima D.},
           giveni={A\bibinitperiod\bibinitdelim D\bibinitperiod}}}%
        {{hash=16acc25e340f704376658da01a13abd1}{%
           family={Wong},
           familyi={W\bibinitperiod},
           given={Wai\bibnamedelima Keong},
           giveni={W\bibinitperiod\bibinitdelim K\bibinitperiod}}}%
        {{hash=1db6910c9819732a35a8a7c96540f6c9}{%
           family={Ibrahim},
           familyi={I\bibinitperiod},
           given={Zina},
           giveni={Z\bibinitperiod}}}%
        {{hash=e113b8a0cc372eceb0fd1508b71d7104}{%
           family={Teo},
           familyi={T\bibinitperiod},
           given={James\bibnamedelima T.},
           giveni={J\bibinitperiod\bibinitdelim T\bibinitperiod}}}%
        {{hash=d4d7ea13413b417a5669a0e3d6d2d38d}{%
           family={Dobson},
           familyi={D\bibinitperiod},
           given={Richard\bibnamedelimb J.\bibnamedelimi B.},
           giveni={R\bibinitperiod\bibinitdelim J\bibinitperiod\bibinitdelim B\bibinitperiod}}}%
      }
      \strng{namehash}{94c9e7b79dc3480f9e1407b66263bb71}
      \strng{fullhash}{b2a38faaba5a59e3330b5c9371d37330}
      \strng{bibnamehash}{94c9e7b79dc3480f9e1407b66263bb71}
      \strng{authorbibnamehash}{94c9e7b79dc3480f9e1407b66263bb71}
      \strng{authornamehash}{94c9e7b79dc3480f9e1407b66263bb71}
      \strng{authorfullhash}{b2a38faaba5a59e3330b5c9371d37330}
      \field{sortinit}{8}
      \field{sortinithash}{a231b008ebf0ecbe0b4d96dcc159445f}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{shorttitle}
      \field{abstract}{Electronic health records (EHR) contain large volumes of unstructured text, requiring the application of information extraction (IE) technologies to enable clinical analysis. We present the open source Medical Concept Annotation Toolkit (MedCAT) that provides: (a) a novel self-supervised machine learning algorithm for extracting concepts using any concept vocabulary including UMLS/SNOMED-CT; (b) a feature-rich annotation interface for customizing and training IE models; and (c) integrations to the broader CogStack ecosystem for vendor-agnostic health system deployment. We show improved performance in extracting UMLS concepts from open datasets (F1:0.448–0.738 vs 0.429–0.650). Further real-world validation demonstrates SNOMED-CT extraction at 3 large London hospitals with self-supervised training over ∼8.8B words from ∼17M clinical records and further fine-tuning with ∼6K clinician annotated examples. We show strong transferability (F1\,{$>$}\,0.94) between hospitals, datasets and concept types indicating cross-domain EHR-agnostic utility for accelerated clinical and research use cases.}
      \field{day}{1}
      \field{issn}{0933-3657}
      \field{journaltitle}{Artificial Intelligence in Medicine}
      \field{langid}{english}
      \field{month}{7}
      \field{shortjournal}{Artificial Intelligence in Medicine}
      \field{shorttitle}{Multi-Domain Clinical Natural Language Processing with {{MedCAT}}}
      \field{title}{Multi-Domain Clinical Natural Language Processing with {{MedCAT}}: {{The Medical Concept Annotation Toolkit}}}
      \field{urlday}{9}
      \field{urlmonth}{8}
      \field{urlyear}{2021}
      \field{volume}{117}
      \field{year}{2021}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \field{pages}{102083}
      \range{pages}{1}
      \verb{doi}
      \verb 10.1016/j.artmed.2021.102083
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/F8ZPZ8V2/Kraljevic et al. - 2021 - Multi-domain clinical natural language processing .pdf;/Users/landes/opt/var/zotero/storage/JTAF32HL/S0933365721000762.html
      \endverb
      \verb{urlraw}
      \verb https://www.sciencedirect.com/science/article/pii/S0933365721000762
      \endverb
      \verb{url}
      \verb https://www.sciencedirect.com/science/article/pii/S0933365721000762
      \endverb
      \keyw{Clinical concept embeddings,Clinical natural language processing,Clinical ontology embeddings,Electronic health record information extraction}
    \endentry
    \entry{reimersSentenceBERTSentenceEmbeddings2019}{inproceedings}{}
      \name{author}{2}{}{%
        {{hash=da9947b27b0d1c4c912e2b391426d443}{%
           family={Reimers},
           familyi={R\bibinitperiod},
           given={Nils},
           giveni={N\bibinitperiod}}}%
        {{hash=ea70b44be1920f6e8c379706bc7d047a}{%
           family={Gurevych},
           familyi={G\bibinitperiod},
           given={Iryna},
           giveni={I\bibinitperiod}}}%
      }
      \list{location}{1}{%
        {Hong Kong, China}%
      }
      \list{publisher}{1}{%
        {Association for Computational Linguistics}%
      }
      \strng{namehash}{2466af6376c9c5e3658dcc6692351f3e}
      \strng{fullhash}{2466af6376c9c5e3658dcc6692351f3e}
      \strng{bibnamehash}{2466af6376c9c5e3658dcc6692351f3e}
      \strng{authorbibnamehash}{2466af6376c9c5e3658dcc6692351f3e}
      \strng{authornamehash}{2466af6376c9c5e3658dcc6692351f3e}
      \strng{authorfullhash}{2466af6376c9c5e3658dcc6692351f3e}
      \field{sortinit}{8}
      \field{sortinithash}{a231b008ebf0ecbe0b4d96dcc159445f}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{shorttitle}
      \field{abstract}{BERT (Devlin et al., 2018) and RoBERTa (Liu et al., 2019) has set a new state-of-the-art performance on sentence-pair regression tasks like semantic textual similarity (STS). However, it requires that both sentences are fed into the network, which causes a massive computational overhead: Finding the most similar pair in a collection of 10,000 sentences requires about 50 million inference computations (\textbackslash textasciitilde65 hours) with BERT. The construction of BERT makes it unsuitable for semantic similarity search as well as for unsupervised tasks like clustering. In this publication, we present Sentence-BERT (SBERT), a modification of the pretrained BERT network that use siamese and triplet network structures to derive semantically meaningful sentence embeddings that can be compared using cosine-similarity. This reduces the effort for finding the most similar pair from 65 hours with BERT / RoBERTa to about 5 seconds with SBERT, while maintaining the accuracy from BERT. We evaluate SBERT and SRoBERTa on common STS tasks and transfer learning tasks, where it outperforms other state-of-the-art sentence embeddings methods.}
      \field{booktitle}{Proceedings of the 2019 {{Conference}} on {{Empirical Methods}} in {{Natural Language Processing}} and the 9th {{International Joint Conference}} on {{Natural Language Processing}} ({{EMNLP-IJCNLP}})}
      \field{eventtitle}{{{EMNLP-IJCNLP}} 2019}
      \field{month}{11}
      \field{shorttitle}{Sentence-{{BERT}}}
      \field{title}{Sentence-{{BERT}}: {{Sentence Embeddings}} Using {{Siamese BERT-Networks}}}
      \field{urlday}{9}
      \field{urlmonth}{11}
      \field{urlyear}{2021}
      \field{year}{2019}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \field{pages}{3982\bibrangedash 3992}
      \range{pages}{11}
      \verb{doi}
      \verb 10.18653/v1/D19-1410
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/2EMJMDC4/Reimers and Gurevych - 2019 - Sentence-BERT Sentence Embeddings using Siamese B.pdf
      \endverb
      \verb{urlraw}
      \verb https://aclanthology.org/D19-1410
      \endverb
      \verb{url}
      \verb https://aclanthology.org/D19-1410
      \endverb
    \endentry
    \entry{dekaImprovedMethodsAid2022}{article}{}
      \name{author}{3}{}{%
        {{hash=700c0c772caf7567b6c99c15ea27b85b}{%
           family={Deka},
           familyi={D\bibinitperiod},
           given={Pritam},
           giveni={P\bibinitperiod}}}%
        {{hash=e424a1b431d3770d94f5253b611db06a}{%
           family={Jurek-Loughrey},
           familyi={J\bibinithyphendelim L\bibinitperiod},
           given={Anna},
           giveni={A\bibinitperiod}}}%
        {{hash=1836ce1e72a133641077f8df764789c8}{%
           family={Padmanabhan},
           familyi={P\bibinitperiod},
           given={Deepak},
           giveni={D\bibinitperiod}}}%
      }
      \strng{namehash}{5b0c0899bb2e6af3c01a471a32bec017}
      \strng{fullhash}{0711c3b4cd6592540a01bd647d8f5156}
      \strng{bibnamehash}{0711c3b4cd6592540a01bd647d8f5156}
      \strng{authorbibnamehash}{0711c3b4cd6592540a01bd647d8f5156}
      \strng{authornamehash}{5b0c0899bb2e6af3c01a471a32bec017}
      \strng{authorfullhash}{0711c3b4cd6592540a01bd647d8f5156}
      \field{sortinit}{8}
      \field{sortinithash}{a231b008ebf0ecbe0b4d96dcc159445f}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{title}
      \field{abstract}{False information in the domain of online health related articles is of great concern,which has been witnessed abundantly in the current pandemic situation of Covid-19.Recent advancements in the field of Machine Learning and Natural Language Processingcan be leveraged to aid people in distinguishing false information from the truth in thedomain of online health articles. Whilst there has been substantial progress in this spaceover the years, research in this area has mainly focused on the sphere of political news.Health fake news is markedly different from fake news in the political context as healthinformation should be evaluated against the most recent and reliable medical resourcessuch as scholarly repositories. However, one of the challenges with such an approachis the retrieval of the pertinent resources. In this work, we formulate two techniquesfor the retrieval of the most relevant authoritative and reliable medical content fromscholarly repositories which can be used to assess veracity of an online health article.The first technique is an unsupervised method of generating queries from claims whichare extracted from an online health article. We propose a three-step approach for it andillustrate that our method is able to generate effective queries which can be used forretrieval of information from medical knowledge databases. The second method involvesa filtering approach for extracting the most relevant information for the claims. Weshow how this can be achieved with the help of state of the art transformer models andillustrate it’s effectiveness over other methods.}
      \field{journaltitle}{Journal of Data Intelligence}
      \field{month}{11}
      \field{number}{4}
      \field{title}{Improved Methods to Aid Unsupervised Evidence-Based Fact Checking for Online Health News}
      \field{urlday}{8}
      \field{urlmonth}{10}
      \field{urlyear}{2024}
      \field{volume}{3}
      \field{year}{2022}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \field{pages}{474\bibrangedash 505}
      \range{pages}{32}
      \verb{doi}
      \verb 10.26421/JDI3.4-5
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/UANCE963/Deka et al. - 2022 - Improved methods to aid unsupervised evidence-based fact checking for online health news.pdf
      \endverb
      \verb{urlraw}
      \verb https://www.rintonpress.com/journals/jdionline.html
      \endverb
      \verb{url}
      \verb https://www.rintonpress.com/journals/jdionline.html
      \endverb
    \endentry
    \entry{wuGoogleNeuralMachine2016}{misc}{}
      \name{author}{31}{}{%
        {{hash=1fc7a40d6072b1bb1d4e56d14ef88e2f}{%
           family={Wu},
           familyi={W\bibinitperiod},
           given={Yonghui},
           giveni={Y\bibinitperiod}}}%
        {{hash=29ea22df63f174ac629e9ef100b40484}{%
           family={Schuster},
           familyi={S\bibinitperiod},
           given={Mike},
           giveni={M\bibinitperiod}}}%
        {{hash=c0d10aaf985cebf8d0497e1828f9313f}{%
           family={Chen},
           familyi={C\bibinitperiod},
           given={Zhifeng},
           giveni={Z\bibinitperiod}}}%
        {{hash=c636f146591d51579a8119b777394878}{%
           family={Le},
           familyi={L\bibinitperiod},
           given={Quoc\bibnamedelima V.},
           giveni={Q\bibinitperiod\bibinitdelim V\bibinitperiod}}}%
        {{hash=e34c5aa67281924804d54d88e58ca38a}{%
           family={Norouzi},
           familyi={N\bibinitperiod},
           given={Mohammad},
           giveni={M\bibinitperiod}}}%
        {{hash=3e02b95f1e35ef8d397835766063a915}{%
           family={Macherey},
           familyi={M\bibinitperiod},
           given={Wolfgang},
           giveni={W\bibinitperiod}}}%
        {{hash=8c2ce3e06666676855e01e5bb2466d92}{%
           family={Krikun},
           familyi={K\bibinitperiod},
           given={Maxim},
           giveni={M\bibinitperiod}}}%
        {{hash=2923de2da7f9b32b957552e414b6bc16}{%
           family={Cao},
           familyi={C\bibinitperiod},
           given={Yuan},
           giveni={Y\bibinitperiod}}}%
        {{hash=841cd6340c46b48aff116aaace5177f6}{%
           family={Gao},
           familyi={G\bibinitperiod},
           given={Qin},
           giveni={Q\bibinitperiod}}}%
        {{hash=15662c2bdf7c38938fe27c84d2f821fe}{%
           family={Macherey},
           familyi={M\bibinitperiod},
           given={Klaus},
           giveni={K\bibinitperiod}}}%
        {{hash=76d78fa8d6bcc0a03c768f284b7445b2}{%
           family={Klingner},
           familyi={K\bibinitperiod},
           given={Jeff},
           giveni={J\bibinitperiod}}}%
        {{hash=2f77a417cb674d5f294913225ae20e42}{%
           family={Shah},
           familyi={S\bibinitperiod},
           given={Apurva},
           giveni={A\bibinitperiod}}}%
        {{hash=b76c4102bf39f677ea9c0f7c2a5f236a}{%
           family={Johnson},
           familyi={J\bibinitperiod},
           given={Melvin},
           giveni={M\bibinitperiod}}}%
        {{hash=6026405c5af9112230e8ff8bf18dd043}{%
           family={Liu},
           familyi={L\bibinitperiod},
           given={Xiaobing},
           giveni={X\bibinitperiod}}}%
        {{hash=540fcd72e1fa4bbed46604f4e6cff817}{%
           family={Kaiser},
           familyi={K\bibinitperiod},
           given={Łukasz},
           giveni={Ł\bibinitperiod}}}%
        {{hash=353c4a3aa4878af27170be1cfd53bd8a}{%
           family={Gouws},
           familyi={G\bibinitperiod},
           given={Stephan},
           giveni={S\bibinitperiod}}}%
        {{hash=cc6590b280716ad064718f8d18f2a53f}{%
           family={Kato},
           familyi={K\bibinitperiod},
           given={Yoshikiyo},
           giveni={Y\bibinitperiod}}}%
        {{hash=ea1d04e9781edc1ab4ccafb0d8ff5179}{%
           family={Kudo},
           familyi={K\bibinitperiod},
           given={Taku},
           giveni={T\bibinitperiod}}}%
        {{hash=fc6dcce1f2845b14d1315cb56f430b85}{%
           family={Kazawa},
           familyi={K\bibinitperiod},
           given={Hideto},
           giveni={H\bibinitperiod}}}%
        {{hash=7970dc920ecd23f635158e89bed903aa}{%
           family={Stevens},
           familyi={S\bibinitperiod},
           given={Keith},
           giveni={K\bibinitperiod}}}%
        {{hash=d115e2de1127519c117a7252205efcdb}{%
           family={Kurian},
           familyi={K\bibinitperiod},
           given={George},
           giveni={G\bibinitperiod}}}%
        {{hash=98e48fd2ef83c15cb4e696e6243eef05}{%
           family={Patil},
           familyi={P\bibinitperiod},
           given={Nishant},
           giveni={N\bibinitperiod}}}%
        {{hash=f27ec46ccd272a021fd78bdac92dd490}{%
           family={Wang},
           familyi={W\bibinitperiod},
           given={Wei},
           giveni={W\bibinitperiod}}}%
        {{hash=2b3412c48bab46f41faab78455fce0e1}{%
           family={Young},
           familyi={Y\bibinitperiod},
           given={Cliff},
           giveni={C\bibinitperiod}}}%
        {{hash=dd794e3fc42625216f13506936f9efea}{%
           family={Smith},
           familyi={S\bibinitperiod},
           given={Jason},
           giveni={J\bibinitperiod}}}%
        {{hash=b137e608b42835dfb224061b97b8aba4}{%
           family={Riesa},
           familyi={R\bibinitperiod},
           given={Jason},
           giveni={J\bibinitperiod}}}%
        {{hash=fbb9f043628eafbecb00f2bfc6ae71bf}{%
           family={Rudnick},
           familyi={R\bibinitperiod},
           given={Alex},
           giveni={A\bibinitperiod}}}%
        {{hash=494b568c5dc85ba8f3f409635f9c5f25}{%
           family={Vinyals},
           familyi={V\bibinitperiod},
           given={Oriol},
           giveni={O\bibinitperiod}}}%
        {{hash=3d11e6f2a0d0a1183b2cf62996525afc}{%
           family={Corrado},
           familyi={C\bibinitperiod},
           given={Greg},
           giveni={G\bibinitperiod}}}%
        {{hash=cc840f3c806989f01823d8e1ef19c2e7}{%
           family={Hughes},
           familyi={H\bibinitperiod},
           given={Macduff},
           giveni={M\bibinitperiod}}}%
        {{hash=4aecfb0cc2e1e3b7899129fa2a94e2b8}{%
           family={Dean},
           familyi={D\bibinitperiod},
           given={Jeffrey},
           giveni={J\bibinitperiod}}}%
      }
      \strng{namehash}{5e7ea1b72e68507bb740c6a9bec1477a}
      \strng{fullhash}{60578079489d2f4fd3110ab834fa69f3}
      \strng{bibnamehash}{5e7ea1b72e68507bb740c6a9bec1477a}
      \strng{authorbibnamehash}{5e7ea1b72e68507bb740c6a9bec1477a}
      \strng{authornamehash}{5e7ea1b72e68507bb740c6a9bec1477a}
      \strng{authorfullhash}{60578079489d2f4fd3110ab834fa69f3}
      \field{sortinit}{8}
      \field{sortinithash}{a231b008ebf0ecbe0b4d96dcc159445f}
      \field{labelnamesource}{author}
      \field{labeltitlesource}{shorttitle}
      \field{abstract}{Neural Machine Translation (NMT) is an end-to-end learning approach for automated translation, with the potential to overcome many of the weaknesses of conventional phrase-based translation systems. Unfortunately, NMT systems are known to be computationally expensive both in training and in translation inference. Also, most NMT systems have difficulty with rare words. These issues have hindered NMT's use in practical deployments and services, where both accuracy and speed are essential. In this work, we present GNMT, Google's Neural Machine Translation system, which attempts to address many of these issues. Our model consists of a deep LSTM network with 8 encoder and 8 decoder layers using attention and residual connections. To improve parallelism and therefore decrease training time, our attention mechanism connects the bottom layer of the decoder to the top layer of the encoder. To accelerate the final translation speed, we employ low-precision arithmetic during inference computations. To improve handling of rare words, we divide words into a limited set of common sub-word units ("wordpieces") for both input and output. This method provides a good balance between the flexibility of "character"-delimited models and the efficiency of "word"-delimited models, naturally handles translation of rare words, and ultimately improves the overall accuracy of the system. Our beam search technique employs a length-normalization procedure and uses a coverage penalty, which encourages generation of an output sentence that is most likely to cover all the words in the source sentence. On the WMT'14 English-to-French and English-to-German benchmarks, GNMT achieves competitive results to state-of-the-art. Using a human side-by-side evaluation on a set of isolated simple sentences, it reduces translation errors by an average of 60\% compared to Google's phrase-based production system.}
      \field{day}{8}
      \field{eprintclass}{cs}
      \field{eprinttype}{arXiv}
      \field{howpublished}{arXiv: 1609.08144 (Only available as arXiv preprint)}
      \field{month}{10}
      \field{shorttitle}{Google's {{Neural Machine Translation System}}}
      \field{title}{Google's {{Neural Machine Translation System}}: {{Bridging}} the {{Gap}} between {{Human}} and {{Machine Translation}}}
      \field{urlday}{24}
      \field{urlmonth}{6}
      \field{urlyear}{2021}
      \field{year}{2016}
      \field{dateera}{ce}
      \field{urldateera}{ce}
      \verb{eprint}
      \verb 1609.08144
      \endverb
      \verb{file}
      \verb /Users/landes/opt/var/zotero/storage/2R6WZHV2/Wu et al. - 2016 - Google's Neural Machine Translation System Bridgi.pdf;/Users/landes/opt/var/zotero/storage/SCSYVHV2/1609.html
      \endverb
      \verb{urlraw}
      \verb http://arxiv.org/abs/1609.08144
      \endverb
      \verb{url}
      \verb http://arxiv.org/abs/1609.08144
      \endverb
      \keyw{Computer Science - Artificial Intelligence,Computer Science - Computation and Language,Computer Science - Machine Learning}
    \endentry
  \enddatalist
\endrefsection
\endinput