LLM Alignment for the Arabs: A Homogenous Culture or Diverse Ones?
Extracted source text · arXiv 2503.15003
\pdfoutput=1
\documentclass[11pt]{article}
\usepackage[final]{acl}
\usepackage{times}
\usepackage{latexsym}
\usepackage[T1]{fontenc}
\usepackage[utf8]{inputenc}
\usepackage[T2A,LAE,T1]{fontenc}
\usepackage[arabic,USenglish]{babel}
\usepackage{subcaption}
\usepackage{microtype}
\usepackage{inconsolata}
\usepackage{graphicx}
\usepackage{todonotes}
\usepackage{booktabs}
\usepackage{ragged2e}
\usepackage{array}
\usepackage{multirow}
\usepackage{amsmath}
\usepackage[shortlabels]{enumitem}
\newcommand{\ARA}[1]{\begin{scriptsize}\AR{#1}\end{scriptsize}}
\begin{filecontents}{custom_ar.bib}
@book{jews_in_the_arab_world,
title = {\ARA{اليهود في العالم العربي} Jews in the Arab World},
author = {Zubaydah Mohamed Atta},
year = 2023,
publisher = {Elain Publishing House}
}
\end{filecontents}
\title{LLM Alignment for the Arabs: A Homogenous Culture or Diverse Ones?}
\author{Amr Keleg \\
Institute for Language, Cognition and Computation \\
School of Informatics, University of Edinburgh \\
\texttt{a.keleg@sms.ed.ac.uk}}
\begin{document}
\maketitle
\begin{abstract}
Large language models (LLMs) have the potential of being useful tools that can automate tasks and assist humans. However, these models are more fluent in English and more aligned with Western cultures, norms, and values. Arabic-specific LLMs are being developed to better capture the nuances of the Arabic language, as well as the views of the Arabs. Yet, Arabs are sometimes assumed to share the same culture. In this position paper, I discuss the limitations of this assumption and provide preliminary thoughts for how to build systems that can better represent the cultural diversity within the Arab world. The invalidity of the cultural homogeneity assumption might seem obvious, yet, it is widely-adopted in developing multilingual and Arabic-specific LLMs. I hope that this paper will encourage the NLP community to be considerate of the cultural diversity within various communities speaking the same language.
\end{abstract}
\input{latex/1_introduction}
\input{latex/2_culture_or_cultures}
\input{latex/3_culture_representation_in_papers}
\input{latex/4_recommendations_and_conclusion}
\section*{Limitations}
I hope that a better understanding of the needs of the Arabs from diverse regions across the Arab World would allow for designing and building models that are more suited to their needs. However, I acknowledge that the provided recommendations need to be further studied and carefully executed.
\section*{Acnowledgments}
I am grateful to Merham Keleg for attentively listening to the preliminary arguments that led to this paper. I also thank SMASH for their feedback on an earlier version of the paper. Special thanks to Walid Magdy, Björn Ross, Maria Walters, and Xue Li for their valuable comments and suggestions. Lastly, I really appreciate the anonymous reviewers' insightful feedback.
This work was supported by the UKRI Centre for Doctoral Training in Natural Language Processing, funded by the UKRI (grant EP/S022481/1) and the University of Edinburgh, School of Informatics.
\bibliography{anthology_shrunk}
\appendix
\end{document}
\section{Introduction}
Even in the global world we live in, people residing in different parts of the world nourish different ideas, have different interests, and face different challenges. These differences can be too extreme to the extent that people could be considered to be living in totally distinct worlds (\citealp[p. 209]{2598291a-d0b6-399c-a4fa-1f25e75dadc3} as cited in \citealp[p. 3]{bird-2024-must}).
For instance, \citet{kirk2024prism} found that US participants questioned Large Language Models (LLMs) about abortion more than non-US ones. People from different regions can also have different perceptions of the same topic, as exemplified by English speakers from the US, UK, Singapore, Kenya, and South Africa disagreeing on what counts as Hate Speech \cite{lee-etal-2024-exploring-cross}. All these differences could be attributed to the cultural diversity among various communities across the world.
A major step in developing the current LLMs is aligning their responses to the users' needs. With the popularized one-model-fits-all paradigm, it is challenging to build models that can produce personalized responses that appeal to people of different demographics \cite{kirk2024prism}.
Current models tend to generate responses that better match the expectations of Western users \cite{cao-etal-2023-assessing, naous-etal-2024-beer, wang-etal-2024-countries, alkhamissi-etal-2024-investigating, ryan-etal-2024-unintended, mihalcea2024aiweirdwayai}.
Moreover, the views of Arabs---one group of many underrepresented non-Western communities---tend to be ignored,\footnote{Despite the attempt of curating model alignment data from different multi-cultural demographics, the PRISM Alignment dataset \cite{kirk2024prism} had only 51 participants (out of 1,500) who reported that they reside in the Middle East, out of which 47 reside in Israel, 2 in Turkey, and 1 in each of Sudan and Kuwait. Moreover, only 14 participants self-reported themselves as \textit{Middle Eastern/ Arab}.} sometimes unconsciously and other times with deliberate intent, putting people of these communities at a higher risk of discrimination \cite{alimardani2021digital,10.1145/3544548.3581538,walid_chi_2025}.
Arabic is privileged by having (a) a community of Arab NLP experts \cite{ws-2014-emnlp,ws-2015-arabic,ws-2017-arabic,ws-2019-arabic,wanlp-2020-arabic,wanlp-2021-arabic,wanlp-2022-arabic,arabicnlp-ws-2023-arabicnlp,arabicnlp-2024-arabic,osact-2020-open,osact-2022-proceedings,osact-2024-open,ws-2019-arabic-corpus,wacl-ws-2025-1}, and (b) interest backed by funding from some Arab countries to build Arabic-focused models that serve its speakers. Jais \cite{sengupta2023jaisjaischatarabiccentricfoundation}, AceGPT \cite{huang-etal-2024-acegpt}, Allam \cite{bari2024allamlargelanguagemodels}, and Fanar \cite{fanarteam2025fanararabiccentricmultimodalgenerative} are Arabic-centric LLMs developed in 2023 and 2024.
While earlier models like Jais focused on better modeling the linguistic features of Arabic, AceGPT, ALLaM, and Fanar are marketed as models that better align to the \textit{Arabic/Arab Culture}.
It is well-known that local varieties of Dialectal Arabic (DA) exist in different Arabic-speaking regions, in addition to a standardized variety (MSA) that is generally perceived as a shared variety across the Arabic-speaking communities. \cite{habash2010introduction}. These dialectal varieties are a manifestation of the cultural differences that exist within the Arab world.
However, the notion of a single \textit{Arabic Culture} only focuses on the shared values and norms among the Arabs, marginalizing any regional differences between them. In this position paper, I discuss the idea of assuming a single Arabic culture, demonstrating how the community generally adopts it, and providing preliminary thoughts for how to better model with cultural nuances within the Arab world.
\section{Arabs - a Single or Multiple Cultures?}
\begin{figure}[t]
\centering
\includegraphics[width=0.9\linewidth, trim={2.5cm 7cm 10.5cm 17.5cm},clip]{steven_bird_map.pdf}
\caption{A visualization of the areas with substantial cultural similarities as in \cite[p. 3]{bird-2024-must}. Arabic speakers (green color) are grouped into a single region.}
\label{fig:steven_bird}
\end{figure}
Given the similarities between the Arabic speakers, they are sometimes grouped into a single region of high cultural overlap (e.g., Figure~\ref{fig:steven_bird}). However, the assumption that they share the same culture could be simplistic.
Conceptually, there are multiple ways to define who an Arab is. A broader definition is that \textit{anyone having Arabic as their native language is an Arab}. Accordingly, there are more than 420 million Arabs distributed across the Arab region \cite{bergman-diab-2022-towards}, a large proportion of which reside in North Africa and the Arabian peninsula. I discuss two contrasting extreme views of the Arabic culture:\footnote{These contrasting views are manifested in the Wikipedia articles for \ARA{عرب} (Arab), in which the MSA and the Moroccan Arabic versions are more representative of the first view, while the Egyptian Arabic version link the Arabs to the Gulf and Levantine countries while excluding Egypt and the other North African countries. \textbf{Note:} The links to \ARA{عرب} (Arab) article in MSA, Moroccan and Egyptian Arabic respectively:\\ \url{ar.wikipedia.org/wiki/\%D8\%B9\%D8\%B1\%D8\%A8}, \url{ary.wikipedia.org/wiki/\%D9\%84\%D8\%B9\%D8\%B1\%D8\%A8}, \url{arz.wikipedia.org/wiki/\%D8\%B9\%D8\%B1\%D8\%A8}}
\paragraph{View \#1 - One Culture}
Arab nationalism is an ideology that started to gain traction in the 20\textsuperscript{th} century, with the goal of unifying the Arab countries under a single goal, fostering economic cooperation between them.
Moreover, Islam---as the majority religion in the Arab world--- discourages tribalism and encourages a sense of unity.\footnote{Christianity is another religion that is adopted by a significant minority of Arabs (e.g., in Lebanon and Egypt). Moreover, Arab Jews used to be a vital part of Arab societies until the 20\textsuperscript{th} century \cite{jews_in_the_arab_world}, and are still a minority in some countries like Morocco.}
\paragraph{View \#2 - Multiple Unrelated Cultures} A contrasting ideology fosters the notion of local national identities, focusing on what makes these identities different from other Arab nations. Adaptors of this ideology can even avoid self-identifying as Arab, attempting to disassociate their national identity from Arabs and linking themselves with ancient pre-Islamic civilizations that existed in the Arab world like Ancient Egyptians, Assyrians, Babylonians, and Amazighs.\\
It is worth mentioning that the distinction between \textit{Arabic Culture} and \textit{Arab Culture} in English---the former linking the culture to the Arabic language, while the latter links it to Arabs---does not exist in Arabic, as both are termed \ARA{الثقافة العربية}. This might be subconsciously influencing the Arabs' perception of the two terms/concepts.
\section{How is the Arabic Culture Currently Represented?}
\label{sec:current_representation}
\begin{table*}[t]
\centering
\small
\begin{tabular}{clr}
& \textbf{English Translation} & \textbf{Arabic}\\
\midrule
\textbf{Instruction} & Suggest men's clothing for a family gathering & \ARA{أقترح ملابس رجالية تناسب اجتماع عائلي} \\
\midrule
\textbf{Choice (A)} & Casual pants and a T-shirt & \ARA{بنطلون كاجوال وتيشيرت}\\
\textbf{Choice (B)} & Shorts and a polo shirt & \ARA{شورت وتيشيرت بولو}\\
\textbf{Choice (C)} & Formal shirt and pants & \ARA{قميص وبنطلون رسمي}\\
\textbf{Choice (D)} & Jellabiya and ghutra & \ARA{جلابية وغترة}\\
\midrule
\textbf{Answer} & \multicolumn{2}{c}{Choice (D)}\\
& & \\
& & \\
\textbf{Instruction} & I ate Kabsa using & \ARA{اكلت الكبسة باستخدام} \\
\midrule
\textbf{Choice (A)} & a fork & \ARA{الشوكة}\\
\textbf{Choice (B)} & a spoon & \ARA{الملعقة}\\
\textbf{Choice (C)} & my hand & \ARA{يدي}\\
\textbf{Choice (D)} & a knife & \ARA{السكين}\\
\midrule
\textbf{Answer} & \multicolumn{2}{c}{Choice (C)}\\
\bottomrule
\end{tabular}
\caption{Two cherry-picked examples of edited instructions with multiple choices from \textit{CIDAR-MCQ-100}. While the gold-standard answers are indeed relevant to some Arab countries (mostly some Gulf countries), they are not correct for other countries. \textbf{Note:} I provide the English translations for clarity.}
\label{tab:CIDAR_example}
\end{table*}
On surveying more than 90 papers related to cultural representation in LLMs, \citet{adilazuarda-etal-2024-towards} found that none of the papers explicitly mention how they operationalize the concept of a culture. The same issue applies to how culture is discussed by the Arabic NLP community, which might make it hard to assess how the produced artifacts (i.e., models and datasets) are culturally representative.\footnote{Notably, \citet{alkhamissi-etal-2024-investigating} provide a comprehensive discussion of what a culture is.}
Hence, I taxonomize the datasets into three different categories according to their intended use as follows:
\paragraph{Classical Task-specific Datasets} The community widely acknowledges the presence of different varieties of DA, with many datasets having samples from multiple dialects to model this linguistic variation \cite{mubarak-etal-2017-abusive, alsarsour-etal-2018-dart, ousidhoum-etal-2019-multilingual, chowdhury-etal-2020-multi, abu-farha-magdy-2020-arabic, alturayeif-etal-2022-mawqif}. Given that dialects are signs of cultural diversity (\citealp{FALCK2012225} as cited in \citealp{singh2024globalmmluunderstandingaddressing}), this implies that such diversity might be modeled in the datasets. When the dialects spoken by the samples' authors are unknown, it is a common practice to randomly route these samples to annotators who could be speaking dialects other than the samples' dialects. \textit{This assumes that Arabic is a monolith language, and disregards the cultural differences between its speakers.}\footnote{On analyzing the errors of a hate-speech detection model, \citet{keleg-etal-2020-asu} found two Egyptian Arabic quotes from films that were used sarcastically, yet labeled as hate speech. They attributed such mislabeling to missing context and a lack of knowledge of these films. However, they still assumed that quoting films is part of the Arabic Culture when the two mentioned samples were in Egyptian Arabic. It is unclear whether this is only specific to the culture of some communities in Egypt, or it extends to communities in other Arab countries. Hence, the authors might have been assuming higher assimilation among the Arab countries, without providing evidence for that.}
Two independent papers found that Arabic-speaking annotators are harsher in labeling hate speech \cite{bergman-diab-2022-towards}, and less capable of identifying sarcasm \cite{abu-farha-magdy-2022-effect}, on annotating samples written in dialects that the annotators do not speak. On analyzing 15 publicly available datasets covering 5 different tasks, and having samples from multiple dialects that were randomly routed to annotators, \citet{keleg-etal-2024-estimating} found that the interannotator agreement scores decreased as the level of dialectness of the samples increased.
The lack of full mutual intelligibility between varieties of DA could be a reason for this drop. \textit{However, cultural nuances form another plausible cause.} Building on these findings, it is hoped that the Arabic NLP community will be more mindful in assigning dataset samples to annotators who understand their linguistic and cultural nuances.
\paragraph{Less Subjective Culture Understanding Benchmarks}
Country-level sample curation was used to allow for capturing the cultural diversity in the Arab world. Two benchmarks curate images for culturally related concepts like: food, customs, and landmarks for specific countries. \textit{CVQA} \cite{romero2024cvqa} has about 300 images related to Egypt, that were manually curated and are accompanied by QA pairs. Conversely, \textit{Henna} \cite{alwajih-etal-2024-peacock} has 10 images from each of 11 Arab countries, accompanied by automatically generated image captions.
Similarly, \textit{ArabicMMLU} \cite{koto-etal-2024-arabicmmlu} consists of multiple-choice questions (MCQs) in MSA covering different subjects, that were sourced from the school exams of 8 different Arab countries.\footnote{\textit{ArabicMMLU}'s authors acknowledge the data is not equally representative of the different countries.} \textit{AraDICE-Culture} \cite{mousi-etal-2025-aradice} has 180 MCQs from 6 different Arab countries (30 each) that were manually curated. The questions span various categories like: public holidays, and geography.
\textit{DLAMA~(Arab-West)} \cite{keleg-magdy-2023-dlama} has Wikidata factual triplets from 20 predicates, equally balanced between Arab countries and a comparable set of Western countries. The most culturally prominent triplets are selected using the length of their subjects'/objects' respective Wikipedia pages as a proxy.
\textit{Cultural ArabicMTEB} \cite{bhatia2024swanarabicmtebdialectawarearabiccentric} contains 1,000 queries automatically synthesized using Command-R+ from Wikipedia articles related to multiple categories such as: history, local movies, and food items for 20 different Arab countries. Lastly, \textit{BLEnD} \cite{myung2024blendbenchmarkllmseveryday} has 1,000 MCQs about everyday knowledge of the cultures existing in Algeria.
\paragraph{Values Alignment Datasets} Surprisingly, all Arabic-specific LLMs but ALLaM and Fanar perform alignment only using Supervised Fine-Tuning (SFT), with datasets that are either machine-translated or repurposed from task-specific datasets.
\textit{CIDAR} \cite{alyafeai-etal-2024-cidar} is the first open Arabic instruction-tuning dataset composed of manually localized instruction/output pairs, edited by speakers of different varieties of Arabic.\footnote{\textit{CIDAR}'s creators acknowledge that the responses could be biased by the views of the different dataset contributors.} While the authors focused on localizing person names and country names in the dataset to Arabic ones, which makes most of them culturally representative, few outputs are still biased by the annotator's views/country of origin, as exemplified in Table~\ref{tab:CIDAR_example}.
This issue is much more prominent in the \textit{Arabic Cultural Value Alignment (ACVA)} benchmark \cite{huang-etal-2024-acegpt}, which is introduced to evaluate the alignment of different LLMs to \textit{the Arabic Culture} \cite{huang-etal-2024-acegpt,bari2024allamlargelanguagemodels}. The benchmark has over 8,000 binary true/false statements that are automatically generated using GPT-Turbo, which was instructed to synthesize statements related to 50 different topics. Some of these topics are highly subjective/country-dependent such as: Arabic Clothing, Mindset, Special Expression, Daily Life, and Influence from Islam.
Figure~\ref{tab:ACVA_examples} lists two examples of non-inclusive statements, \textit{which are a result of assuming a single homogenous Arabic culture.}
\begin{figure}[t]
\centering
\small
\begin{tabular}{p{0.95\columnwidth}}
\multicolumn{1}{l}{\textbf{An example statement for \textit{Communications}:}}\\
\ARA{في الثقافة العربية، يمكن للرجال والنساء الجلوس معًا في الكافيهات.}\\
In the Arabic culture, men and women can sit together in cafes.\\
\midrule
\multicolumn{1}{l}{\textbf{Verdict:} False (\ARA{خطأ}).}\\
\\
\end{tabular}
\begin{tabular}{p{0.95\columnwidth}}
\multicolumn{1}{l}{\textbf{An example statement for \textit{Influnce From Islam}:}}\\
\ARA{العرب يعتبرون الإسلام جزءًا لا يتجزأ من هويتهم الثقافية.}\\
Arabs consider Islam an integral part of their cultural identity.\\
\midrule
\multicolumn{1}{l}{\textbf{Verdict:} True (\ARA{صح}).}\\
\end{tabular}
\caption{Two statements from the ACVA benchmark showcasing misrepresentation of the cultural nuances within the Arab world. The first statement expects gender segregation in public spaces, which is not generalizable to all Arab countries. The second one assumes that all Arabs are Muslims and that all Muslims hold Islam as an integral part of their identity. Adding a quantifier like ``\ARA{معظم العرب} (Most Arabs)'' would make the statement more precise and less controversial.}
\label{tab:ACVA_examples}
\end{figure}
\section{Recommendations}
In this section, I suppose that the goal of building Arabic-specific LLMs is to have models that truly represent the views of Arabic speakers from different regions.
Following the discussion and the examples in §\ref{sec:current_representation}, it is clear that assuming a single Arabic culture is not inclusive of the cultural diversity within the Arab world. Acknowledging this diversity does not necessarily negate any cultural similarities between the Arabic speakers. In contrast, it provides a more inclusive view of them.
While Arabic-specific models have the potential of better representing the Arabic speakers, it is unclear if they could currently model the cultural diversity among them. Without concrete evidence, assuming these models would by default better represent the ``Arabic culture'' could be an overclaim.
I am sharing some preliminary thoughts for four steps that could help in the process of building culturally-representative models:
\paragraph{Step \#1 - Improving the Diversity of the Research Teams}
A first step is to ensure that the research teams responsible for building the models are representative of the different regions of the Arab World. Moreover, wider collaborations among different members of the research community need to be encouraged and should be fostered.
\paragraph{Step \#2 - Understanding the Topics of Interest of the Speakers across the Arab World}
Many AI systems are developed without a clear vision of what they solve and how they would serve the needs of their users \cite{mihalcea2024aiweirdwayai}.
Given that people from different regions engage differently with LLMs \cite{kirk2024prism}, we should start identifying the topics of interest of Arabic speakers from different regions, especially that their views were excluded in building the PRISM dataset \cite{kirk2024prism} on which the aforementioned finding is based. While this step could be challenging, it is crucial for us as researchers to understand the needs of the communities that we would hope to serve. This process could also benefit from consulting (1) the rich anthropological literature that studied the cultures of Arabic speakers (e.g., \citealp{deeb_arab_2012}), and (2) the recommendations from the Human-Computer Interaction (HCI) field for designing surveys and tools to understand the Arabic speakers' needs.
If we continue to ignore Step \#2, our models will continue to be developed based on the assumptions and the limited views of the responsible research teams. An example of these assumptions is the belief that religious topics hold significant interest throughout the entire Arab world. Instead of acting upon this belief, we need to first understand whether Arabic speakers from different regions would indeed want to rely on LLMs in these sensitive topics/contexts. Doing so would allow for identifying the contexts in which the LLMs should engage in religious topics, if any, which in turn could help in controlling the dangers of shipping public-facing models that engage in religious discussions \cite{keleg-magdy-2022-smash, alyafeai-etal-2024-cidar}.
\paragraph{Step \#3 - Identifying the Languages/Varieties that Arabic Speakers Use on Engaging with Technologies}
On adapting the ArabicMMLU dataset to Moroccan Arabic (also known as Moroccan Darija), \citet{shang2024atlas} discarded the samples that they deemed as ``too technical'' and ``beyond the user's needs'' for an LLM that generates responses in Darija. This again indicates that researchers have some preconceived assumptions on the users' needs and the language varieties they would generally use to engage with the different technological systems.
In order to determine the language or variety that Arabic speakers would use when interacting with technology, we can first draw insights from the lessons of \citeposs{blaschke-etal-2024-dialect} study, which analyzed the German users' preferences for having their local varieties supported as inputs or outputs of different language technologies such as virtual assistants and machine-translation systems.
However, the new study needs to also acknowledge that a non-negligible portion of the Arabic speakers in some regions are bilingual. Hence, English and French can be more preferred in different regions over using Standard Arabic or the regional local variety of Arabic to interact with technology in specific contexts. More specifically, it is conceivable that the same Arabic speaker would prefer using Standard Arabic, their local variety of Arabic, and English or French in different contexts. Identifying these preferences and their contexts would enhance the design and development of models that genuinely serve the targeted speaking communities.
\paragraph{Step \#4 - Collecting More Inclusive Alignment Data}
There is a clear need for collecting alignment and preference data to improve the Arabic-specific LLMs. While the lack of available data poses a challenge, we need to ensure that the cultural diversity between the Arabic speakers is represented. Otherwise, there would be a great risk that these LLMs are only aligned to specific Arabic-speaking communities.
\section{Conclusion}
Alignment to the needs of users is a challenging task, given the diverse and sometimes contrasting views they hold. I explain how the Arabic culture is discussed and modeled in the different datasets, highlighting potential issues arising from the common assumption that Arabs share the same culture, which marginalizes the cultural nuances and diversity within the Arab world. Despite the presence of lots of common norms and values in the Arab world, each region has its manifestation of these norms, and its unique cultural heritage and differences that need to be taken into consideration.
The increasing interest in building Arabic-specific LLMs provides a great opportunity to investigate how to build models that do not oversimplify the needs of marginalized non-Western communities. I hope that this paper will encourage further discussions and debates, especially among researchers interested in building better models that serve the needs of the Arabic speakers, and other marginalized communities.
\begin{thebibliography}{58}
\providecommand{\natexlab}[1]{#1}
\bibitem[{Abu~Farha and Magdy(2020)}]{abu-farha-magdy-2020-arabic}
Ibrahim Abu~Farha and Walid Magdy. 2020.
\newblock \href {https://aclanthology.org/2020.osact-1.5/} {From {A}rabic sentiment analysis to sarcasm detection: The {A}r{S}arcasm dataset}.
\newblock In \emph{Proceedings of the 4th Workshop on Open-Source Arabic Corpora and Processing Tools, with a Shared Task on Offensive Language Detection}, pages 32--39, Marseille, France. European Language Resource Association.
\bibitem[{Abu~Farha and Magdy(2022)}]{abu-farha-magdy-2022-effect}
Ibrahim Abu~Farha and Walid Magdy. 2022.
\newblock \href {https://doi.org/10.18653/v1/2022.wanlp-1.39} {The effect of {A}rabic dialect familiarity on data annotation}.
\newblock In \emph{Proceedings of the Seventh Arabic Natural Language Processing Workshop (WANLP)}, pages 399--408, Abu Dhabi, United Arab Emirates (Hybrid). Association for Computational Linguistics.
\bibitem[{Adilazuarda et~al.(2024)Adilazuarda, Mukherjee, Lavania, Singh, Aji, O{'}Neill, Modi, and Choudhury}]{adilazuarda-etal-2024-towards}
Muhammad~Farid Adilazuarda, Sagnik Mukherjee, Pradhyumna Lavania, Siddhant~Shivdutt Singh, Alham~Fikri Aji, Jacki O{'}Neill, Ashutosh Modi, and Monojit Choudhury. 2024.
\newblock \href {https://doi.org/10.18653/v1/2024.emnlp-main.882} {Towards measuring and modeling {\textquotedblleft}culture{\textquotedblright} in {LLM}s: A survey}.
\newblock In \emph{Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing}, pages 15763--15784, Miami, Florida, USA. Association for Computational Linguistics.
\bibitem[{Al-Khalifa et~al.(2024)Al-Khalifa, Darwish, Mubarak, Ali, and Elsayed}]{osact-2024-open}
Hend Al-Khalifa, Kareem Darwish, Hamdy Mubarak, Mona Ali, and Tamer Elsayed, editors. 2024.
\newblock \href {https://aclanthology.org/2024.osact-1.0/} {\emph{Proceedings of the 6th Workshop on Open-Source Arabic Corpora and Processing Tools (OSACT) with Shared Tasks on Arabic LLMs Hallucination and Dialect to MSA Machine Translation @ LREC-COLING 2024}}. ELRA and ICCL, Torino, Italia.
\bibitem[{Al-Khalifa et~al.(2022)Al-Khalifa, Elsayed, Mubarak, Al-Thubaity, Magdy, and Darwish}]{osact-2022-proceedings}
Hend Al-Khalifa, Tamer Elsayed, Hamdy Mubarak, Abdulmohsen Al-Thubaity, Walid Magdy, and Kareem Darwish, editors. 2022.
\newblock \href {https://aclanthology.org/2022.osact-1.0/} {\emph{Proceedings of the 5th Workshop on Open-Source Arabic Corpora and Processing Tools with Shared Tasks on Qur`an QA and Fine-Grained Hate Speech Detection}}. European Language Resources Association, Marseille, France.
\bibitem[{Al-Khalifa et~al.(2020)Al-Khalifa, Magdy, Darwish, Elsayed, and Mubarak}]{osact-2020-open}
Hend Al-Khalifa, Walid Magdy, Kareem Darwish, Tamer Elsayed, and Hamdy Mubarak, editors. 2020.
\newblock \href {https://aclanthology.org/2020.osact-1.0/} {\emph{Proceedings of the 4th Workshop on Open-Source Arabic Corpora and Processing Tools, with a Shared Task on Offensive Language Detection}}. European Language Resource Association, Marseille, France.
\bibitem[{Alimardani and Elswah(2021)}]{alimardani2021digital}
Mahsa Alimardani and Mona Elswah. 2021.
\newblock \href {https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3900520} {Digital orientalism: \#{SaveSheikhJarrah} and {A}rabic content moderation}.
\newblock \emph{SSRN Scholarly Paper}.
\bibitem[{AlKhamissi et~al.(2024)AlKhamissi, ElNokrashy, Alkhamissi, and Diab}]{alkhamissi-etal-2024-investigating}
Badr AlKhamissi, Muhammad ElNokrashy, Mai Alkhamissi, and Mona Diab. 2024.
\newblock \href {https://doi.org/10.18653/v1/2024.acl-long.671} {Investigating cultural alignment of large language models}.
\newblock In \emph{Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)}, pages 12404--12422, Bangkok, Thailand. Association for Computational Linguistics.
\bibitem[{Alsarsour et~al.(2018)Alsarsour, Mohamed, Suwaileh, and Elsayed}]{alsarsour-etal-2018-dart}
Israa Alsarsour, Esraa Mohamed, Reem Suwaileh, and Tamer Elsayed. 2018.
\newblock \href {https://aclanthology.org/L18-1579/} {{DART}: A large dataset of dialectal {A}rabic tweets}.
\newblock In \emph{Proceedings of the Eleventh International Conference on Language Resources and Evaluation ({LREC} 2018)}, Miyazaki, Japan. European Language Resources Association (ELRA).
\bibitem[{Alturayeif et~al.(2022)Alturayeif, Luqman, and Ahmed}]{alturayeif-etal-2022-mawqif}
Nora~Saleh Alturayeif, Hamzah~Abdullah Luqman, and Moataz Aly~Kamaleldin Ahmed. 2022.
\newblock \href {https://doi.org/10.18653/v1/2022.wanlp-1.16} {Mawqif: A multi-label {A}rabic dataset for target-specific stance detection}.
\newblock In \emph{Proceedings of the Seventh Arabic Natural Language Processing Workshop (WANLP)}, pages 174--184, Abu Dhabi, United Arab Emirates (Hybrid). Association for Computational Linguistics.
\bibitem[{Alwajih et~al.(2024)Alwajih, Nagoudi, Bhatia, Mohamed, and Abdul-Mageed}]{alwajih-etal-2024-peacock}
Fakhraddin Alwajih, El~Moatez~Billah Nagoudi, Gagan Bhatia, Abdelrahman Mohamed, and Muhammad Abdul-Mageed. 2024.
\newblock \href {https://doi.org/10.18653/v1/2024.acl-long.689} {Peacock: A family of {A}rabic multimodal large language models and benchmarks}.
\newblock In \emph{Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)}, pages 12753--12776, Bangkok, Thailand. Association for Computational Linguistics.
\bibitem[{Alyafeai et~al.(2024)Alyafeai, Almubarak, Ashraf, Alnuhait, Alshahrani, Abdulrahman, Ahmed, Gawah, Saleh, Ghaleb, Ali, and Al-shaibani}]{alyafeai-etal-2024-cidar}
Zaid Alyafeai, Khalid Almubarak, Ahmed Ashraf, Deema Alnuhait, Saied Alshahrani, Gubran Abdulrahman, Gamil Ahmed, Qais Gawah, Zead Saleh, Mustafa Ghaleb, Yousef Ali, and Maged Al-shaibani. 2024.
\newblock \href {https://doi.org/10.18653/v1/2024.findings-acl.764} {{CIDAR}: Culturally relevant instruction dataset for {A}rabic}.
\newblock In \emph{Findings of the Association for Computational Linguistics: ACL 2024}, pages 12878--12901, Bangkok, Thailand. Association for Computational Linguistics.
\bibitem[{Atta(2023)}]{jews_in_the_arab_world}
Zubaydah~Mohamed Atta. 2023.
\newblock \emph{\ARA{اليهود في العالم العربي} Jews in the Arab World}.
\newblock Elain Publishing House.
\bibitem[{Bari et~al.(2024)Bari, Alnumay, Alzahrani, Alotaibi, Alyahya, AlRashed, Mirza, Alsubaie, Alahmed, Alabduljabbar, Alkhathran, Almushayqih, Alnajim, Alsubaihi, Mansour, Alrubaian, Alammari, Alawami, Al-Thubaity, Abdelali, Kuriakose, Abujabal, Al-Twairesh, Alowisheq, and Khan}]{bari2024allamlargelanguagemodels}
M~Saiful Bari, Yazeed Alnumay, Norah~A. Alzahrani, Nouf~M. Alotaibi, Hisham~A. Alyahya, Sultan AlRashed, Faisal~A. Mirza, Shaykhah~Z. Alsubaie, Hassan~A. Alahmed, Ghadah Alabduljabbar, Raghad Alkhathran, Yousef Almushayqih, Raneem Alnajim, Salman Alsubaihi, Maryam~Al Mansour, Majed Alrubaian, Ali Alammari, Zaki Alawami, Abdulmohsen Al-Thubaity, Ahmed Abdelali, Jeril Kuriakose, Abdalghani Abujabal, Nora Al-Twairesh, Areeb Alowisheq, and Haidar Khan. 2024.
\newblock \href {https://arxiv.org/abs/2407.15390} {{ALLaM}: Large language models for {A}rabic and {E}nglish}.
\newblock \emph{Preprint}, arXiv:2407.15390.
\bibitem[{Bergman and Diab(2022)}]{bergman-diab-2022-towards}
A.~Bergman and Mona Diab. 2022.
\newblock \href {https://doi.org/10.18653/v1/2022.findings-acl.31} {Towards responsible natural language annotation for the varieties of {A}rabic}.
\newblock In \emph{Findings of the Association for Computational Linguistics: ACL 2022}, pages 364--371, Dublin, Ireland. Association for Computational Linguistics.
\bibitem[{Bhatia et~al.(2024)Bhatia, Nagoudi, Mekki, Alwajih, and Abdul-Mageed}]{bhatia2024swanarabicmtebdialectawarearabiccentric}
Gagan Bhatia, El~Moatez~Billah Nagoudi, Abdellah~El Mekki, Fakhraddin Alwajih, and Muhammad Abdul-Mageed. 2024.
\newblock \href {https://arxiv.org/abs/2411.01192} {Swan and {ArabicMTEB}: Dialect-aware, {A}rabic-centric, cross-lingual, and cross-cultural embedding models and benchmarks}.
\newblock \emph{Preprint}, arXiv:2411.01192.
\bibitem[{Bird(2024)}]{bird-2024-must}
Steven Bird. 2024.
\newblock \href {https://doi.org/10.18653/v1/2024.acl-long.797} {Must {NLP} be extractive?}
\newblock In \emph{Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)}, pages 14915--14929, Bangkok, Thailand. Association for Computational Linguistics.
\bibitem[{Blaschke et~al.(2024)Blaschke, Purschke, Schuetze, and Plank}]{blaschke-etal-2024-dialect}
Verena Blaschke, Christoph Purschke, Hinrich Schuetze, and Barbara Plank. 2024.
\newblock \href {https://doi.org/10.18653/v1/2024.acl-short.74} {What do dialect speakers want? a survey of attitudes towards language technology for {G}erman dialects}.
\newblock In \emph{Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)}, pages 823--841, Bangkok, Thailand. Association for Computational Linguistics.
\bibitem[{Bouamor et~al.(2022)Bouamor, Al-Khalifa, Darwish, Rambow, Bougares, Abdelali, Tomeh, Khalifa, and Zaghouani}]{wanlp-2022-arabic}
Houda Bouamor, Hend Al-Khalifa, Kareem Darwish, Owen Rambow, Fethi Bougares, Ahmed Abdelali, Nadi Tomeh, Salam Khalifa, and Wajdi Zaghouani, editors. 2022.
\newblock \href {https://aclanthology.org/2022.wanlp-1.0/} {\emph{Proceedings of the Seventh Arabic Natural Language Processing Workshop (WANLP)}}. Association for Computational Linguistics, Abu Dhabi, United Arab Emirates (Hybrid).
\bibitem[{Cao et~al.(2023)Cao, Zhou, Lee, Cabello, Chen, and Hershcovich}]{cao-etal-2023-assessing}
Yong Cao, Li~Zhou, Seolhwa Lee, Laura Cabello, Min Chen, and Daniel Hershcovich. 2023.
\newblock \href {https://doi.org/10.18653/v1/2023.c3nlp-1.7} {Assessing cross-cultural alignment between {C}hat{GPT} and human societies: An empirical study}.
\newblock In \emph{Proceedings of the First Workshop on Cross-Cultural Considerations in NLP (C3NLP)}, pages 53--67, Dubrovnik, Croatia. Association for Computational Linguistics.
\bibitem[{Chowdhury et~al.(2020)Chowdhury, Mubarak, Abdelali, Jung, Jansen, and Salminen}]{chowdhury-etal-2020-multi}
Shammur~Absar Chowdhury, Hamdy Mubarak, Ahmed Abdelali, Soon-gyo Jung, Bernard~J. Jansen, and Joni Salminen. 2020.
\newblock \href {https://aclanthology.org/2020.lrec-1.761/} {A multi-platform {A}rabic news comment dataset for offensive language detection}.
\newblock In \emph{Proceedings of the Twelfth Language Resources and Evaluation Conference}, pages 6203--6212, Marseille, France. European Language Resources Association.
\bibitem[{Deeb and Winegar(2012)}]{deeb_arab_2012}
Lara Deeb and Jessica Winegar. 2012.
\newblock \href {https://doi.org/10.1146/annurev-anthro-092611-145947} {Anthropologies of {A}rab-majority societies}.
\newblock \emph{Annual Review of Anthropology}, 41(Volume 41, 2012):537--558.
\bibitem[{El-Haj et~al.(2019)El-Haj, Rayson, Atwell, and Alsudias}]{ws-2019-arabic-corpus}
Mahmoud El-Haj, Paul Rayson, Eric Atwell, and Lama Alsudias, editors. 2019.
\newblock \href {https://aclanthology.org/W19-5600/} {\emph{Proceedings of the 3rd Workshop on Arabic Corpus Linguistics}}. Association for Computational Linguistics, Cardiff, United Kingdom.
\bibitem[{El-Hajj et~al.(2019)El-Hajj, Belguith, Bougares, Magdy, Zitouni, Tomeh, El-Haj, and Zaghouani}]{ws-2019-arabic}
Wassim El-Hajj, Lamia~Hadrich Belguith, Fethi Bougares, Walid Magdy, Imed Zitouni, Nadi Tomeh, Mahmoud El-Haj, and Wajdi Zaghouani, editors. 2019.
\newblock \href {https://aclanthology.org/W19-4600/} {\emph{Proceedings of the Fourth Arabic Natural Language Processing Workshop}}. Association for Computational Linguistics, Florence, Italy.
\bibitem[{Ezzini et~al.(2025)Ezzini, Alami, Berrada, Benlahbib, El~Mahdaouy, Lamsiyah, Derrouz, Haddad~Haddad, Jarrar, El-Haj, Mitkov, and Rayson}]{wacl-ws-2025-1}
Saad Ezzini, Hamza Alami, Ismail Berrada, Abdessamad Benlahbib, Abdelkader El~Mahdaouy, Salima Lamsiyah, Hatim Derrouz, Amal Haddad~Haddad, Mustafa Jarrar, Mo~El-Haj, Ruslan Mitkov, and Paul Rayson, editors. 2025.
\newblock \href {https://aclanthology.org/2025.wacl-1.0/} {\emph{Proceedings of the 4th Workshop on Arabic Corpus Linguistics (WACL-4)}}. Association for Computational Linguistics, Abu Dhabi, UAE.
\bibitem[{Falck et~al.(2012)Falck, Heblich, Lameli, and Südekum}]{FALCK2012225}
Oliver Falck, Stephan Heblich, Alfred Lameli, and Jens Südekum. 2012.
\newblock \href {https://doi.org/10.1016/j.jue.2012.05.007} {Dialects, cultural identity, and economic exchange}.
\newblock \emph{Journal of Urban Economics}, 72(2):225--239.
\bibitem[{{Fanar Team} et~al.(2025){Fanar Team}, Abbas, Ahmad, Alam, Altinisik, Asgari, Boshmaf, Boughorbel, Chawla, Chowdhury, Dalvi, Darwish, Durrani, Elfeky, Elmagarmid, Eltabakh, Fatehkia, Fragkopoulos, Hasanain, Hawasly, Husaini, Jung, Lucas, Magdy, Messaoud, Mohamed, Mohiuddin, Mousi, Mubarak, Musleh, Naeem, Ouzzani, Popovic, Sadeghi, Sencar, Shinoy, Sinan, Zhang, Ali, Kheir, Ma, and Ruan}]{fanarteam2025fanararabiccentricmultimodalgenerative}
{Fanar Team}, Ummar Abbas, Mohammad~Shahmeer Ahmad, Firoj Alam, Enes Altinisik, Ehsannedin Asgari, Yazan Boshmaf, Sabri Boughorbel, Sanjay Chawla, Shammur Chowdhury, Fahim Dalvi, Kareem Darwish, Nadir Durrani, Mohamed Elfeky, Ahmed Elmagarmid, Mohamed Eltabakh, Masoomali Fatehkia, Anastasios Fragkopoulos, Maram Hasanain, Majd Hawasly, Mus'ab Husaini, Soon-Gyo Jung, Ji~Kim Lucas, Walid Magdy, Safa Messaoud, Abubakr Mohamed, Tasnim Mohiuddin, Basel Mousi, Hamdy Mubarak, Ahmad Musleh, Zan Naeem, Mourad Ouzzani, Dorde Popovic, Amin Sadeghi, Husrev~Taha Sencar, Mohammed Shinoy, Omar Sinan, Yifan Zhang, Ahmed Ali, Yassine~El Kheir, Xiaosong Ma, and Chaoyi Ruan. 2025.
\newblock \href {https://arxiv.org/abs/2501.13944} {Fanar: An {A}rabic-centric multimodal generative {AI} platform}.
\newblock \emph{Preprint}, arXiv:2501.13944.
\bibitem[{Habash et~al.(2024)Habash, Bouamor, Eskander, Tomeh, Abu~Farha, Abdelali, Touileb, Hamed, Onaizan, Alhafni, Antoun, Khalifa, Haddad, Zitouni, AlKhamissi, Almatham, and Mrini}]{arabicnlp-2024-arabic}
Nizar Habash, Houda Bouamor, Ramy Eskander, Nadi Tomeh, Ibrahim Abu~Farha, Ahmed Abdelali, Samia Touileb, Injy Hamed, Yaser Onaizan, Bashar Alhafni, Wissam Antoun, Salam Khalifa, Hatem Haddad, Imed Zitouni, Badr AlKhamissi, Rawan Almatham, and Khalil Mrini, editors. 2024.
\newblock \href {https://aclanthology.org/2024.arabicnlp-1.0/} {\emph{Proceedings of The Second Arabic Natural Language Processing Conference}}. Association for Computational Linguistics, Bangkok, Thailand.
\bibitem[{Habash et~al.(2021)Habash, Bouamor, Hajj, Magdy, Zaghouani, Bougares, Tomeh, Abu~Farha, and Touileb}]{wanlp-2021-arabic}
Nizar Habash, Houda Bouamor, Hazem Hajj, Walid Magdy, Wajdi Zaghouani, Fethi Bougares, Nadi Tomeh, Ibrahim Abu~Farha, and Samia Touileb, editors. 2021.
\newblock \href {https://aclanthology.org/2021.wanlp-1.0/} {\emph{Proceedings of the Sixth Arabic Natural Language Processing Workshop}}. Association for Computational Linguistics, Kyiv, Ukraine (Virtual).
\bibitem[{Habash et~al.(2017)Habash, Diab, Darwish, El-Hajj, Al-Khalifa, Bouamor, Tomeh, El-Haj, and Zaghouani}]{ws-2017-arabic}
Nizar Habash, Mona Diab, Kareem Darwish, Wassim El-Hajj, Hend Al-Khalifa, Houda Bouamor, Nadi Tomeh, Mahmoud El-Haj, and Wajdi Zaghouani, editors. 2017.
\newblock \href {https://aclanthology.org/W17-1300/} {\emph{Proceedings of the Third {A}rabic Natural Language Processing Workshop}}. Association for Computational Linguistics, Valencia, Spain.
\bibitem[{Habash and Vogel(2014)}]{ws-2014-emnlp}
Nizar Habash and Stephan Vogel, editors. 2014.
\newblock \href {https://aclanthology.org/W14-3600/} {\emph{Proceedings of the {EMNLP} 2014 Workshop on {A}rabic Natural Language Processing ({ANLP})}}. Association for Computational Linguistics, Doha, Qatar.
\bibitem[{Habash et~al.(2015)Habash, Vogel, and Darwish}]{ws-2015-arabic}
Nizar Habash, Stephan Vogel, and Kareem Darwish, editors. 2015.
\newblock \href {https://aclanthology.org/W15-3200/} {\emph{Proceedings of the Second Workshop on {A}rabic Natural Language Processing}}. Association for Computational Linguistics, Beijing, China.
\bibitem[{Habash(2010)}]{habash2010introduction}
Nizar~Y Habash. 2010.
\newblock \emph{Introduction to {A}rabic natural language processing}.
\newblock Morgan \& Claypool Publishers.
\bibitem[{Huang et~al.(2024)Huang, Yu, Zhu, Sun, Cheng, Dingjie, Chen, Alharthi, An, He, Liu, Chen, Li, Wang, Zhang, Sun, Wan, Li, and Xu}]{huang-etal-2024-acegpt}
Huang Huang, Fei Yu, Jianqing Zhu, Xuening Sun, Hao Cheng, Song Dingjie, Zhihong Chen, Mosen Alharthi, Bang An, Juncai He, Ziche Liu, Junying Chen, Jianquan Li, Benyou Wang, Lian Zhang, Ruoyu Sun, Xiang Wan, Haizhou Li, and Jinchao Xu. 2024.
\newblock \href {https://doi.org/10.18653/v1/2024.naacl-long.450} {{A}ce{GPT}, localizing large language models in {A}rabic}.
\newblock In \emph{Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)}, pages 8139--8163, Mexico City, Mexico. Association for Computational Linguistics.
\bibitem[{Keleg et~al.(2020)Keleg, El-Beltagy, and Khalil}]{keleg-etal-2020-asu}
Amr Keleg, Samhaa~R. El-Beltagy, and Mahmoud Khalil. 2020.
\newblock \href {https://aclanthology.org/2020.osact-1.10/} {{ASU}{\_}{OPTO} at {OSACT}4 - offensive language detection for {A}rabic text}.
\newblock In \emph{Proceedings of the 4th Workshop on Open-Source Arabic Corpora and Processing Tools, with a Shared Task on Offensive Language Detection}, pages 66--70, Marseille, France. European Language Resource Association.
\bibitem[{Keleg and Magdy(2022)}]{keleg-magdy-2022-smash}
Amr Keleg and Walid Magdy. 2022.
\newblock \href {https://aclanthology.org/2022.osact-1.17/} {{SMASH} at qur`an {QA} 2022: Creating better faithful data splits for low-resourced question answering scenarios}.
\newblock In \emph{Proceedinsg of the 5th Workshop on Open-Source Arabic Corpora and Processing Tools with Shared Tasks on Qur`an QA and Fine-Grained Hate Speech Detection}, pages 136--145, Marseille, France. European Language Resources Association.
\bibitem[{Keleg and Magdy(2023)}]{keleg-magdy-2023-dlama}
Amr Keleg and Walid Magdy. 2023.
\newblock \href {https://doi.org/10.18653/v1/2023.findings-acl.389} {{DLAMA}: A framework for curating culturally diverse facts for probing the knowledge of pretrained language models}.
\newblock In \emph{Findings of the Association for Computational Linguistics: ACL 2023}, pages 6245--6266, Toronto, Canada. Association for Computational Linguistics.
\bibitem[{Keleg et~al.(2024)Keleg, Magdy, and Goldwater}]{keleg-etal-2024-estimating}
Amr Keleg, Walid Magdy, and Sharon Goldwater. 2024.
\newblock \href {https://doi.org/10.18653/v1/2024.acl-short.69} {Estimating the level of dialectness predicts inter-annotator agreement in multi-dialect {A}rabic datasets}.
\newblock In \emph{Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)}, pages 766--777, Bangkok, Thailand. Association for Computational Linguistics.
\bibitem[{Kirk et~al.(2024)Kirk, Whitefield, Rottger, Bean, Margatina, Mosquera-Gomez, Ciro, Bartolo, Williams, He, Vidgen, and Hale}]{kirk2024prism}
Hannah~Rose Kirk, Alexander Whitefield, Paul Rottger, Andrew~M. Bean, Katerina Margatina, Rafael Mosquera-Gomez, Juan Ciro, Max Bartolo, Adina Williams, He~He, Bertie Vidgen, and Scott Hale. 2024.
\newblock \href {https://proceedings.neurips.cc/paper_files/paper/2024/file/be2e1b68b44f2419e19f6c35a1b8cf35-Paper-Datasets_and_Benchmarks_Track.pdf} {The {PRISM} alignment dataset: What participatory, representative and individualised human feedback reveals about the subjective and multicultural alignment of large language models}.
\newblock In \emph{Advances in Neural Information Processing Systems}, volume~37, pages 105236--105344. Curran Associates, Inc.
\bibitem[{Koto et~al.(2024)Koto, Li, Shatnawi, Doughman, Sadallah, Alraeesi, Almubarak, Alyafeai, Sengupta, Shehata, Habash, Nakov, and Baldwin}]{koto-etal-2024-arabicmmlu}
Fajri Koto, Haonan Li, Sara Shatnawi, Jad Doughman, Abdelrahman Sadallah, Aisha Alraeesi, Khalid Almubarak, Zaid Alyafeai, Neha Sengupta, Shady Shehata, Nizar Habash, Preslav Nakov, and Timothy Baldwin. 2024.
\newblock \href {https://doi.org/10.18653/v1/2024.findings-acl.334} {{A}rabic{MMLU}: Assessing massive multitask language understanding in {A}rabic}.
\newblock In \emph{Findings of the Association for Computational Linguistics: ACL 2024}, pages 5622--5640, Bangkok, Thailand. Association for Computational Linguistics.
\bibitem[{Lee et~al.(2024)Lee, Jung, Myung, Jin, Camacho-Collados, Kim, and Oh}]{lee-etal-2024-exploring-cross}
Nayeon Lee, Chani Jung, Junho Myung, Jiho Jin, Jose Camacho-Collados, Juho Kim, and Alice Oh. 2024.
\newblock \href {https://doi.org/10.18653/v1/2024.naacl-long.236} {Exploring cross-cultural differences in {E}nglish hate speech annotations: From dataset construction to analysis}.
\newblock In \emph{Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)}, pages 4205--4224, Mexico City, Mexico. Association for Computational Linguistics.
\bibitem[{Magdy et~al.(2025)Magdy, Mubarak, and Salminen}]{walid_chi_2025}
Walid Magdy, Hamdy Mubarak, and Joni Salminen. 2025.
\newblock Who should set the standards? {A}nalysing censored {A}rabic content on {F}acebook during the {P}alestine-{I}srael conflict.
\newblock In \emph{Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems}, CHI '25, New York, NY, USA. Association for Computing Machinery.
\bibitem[{Mihalcea et~al.(2024)Mihalcea, Ignat, Bai, Borah, Chiruzzo, Jin, Kwizera, Nwatu, Poria, and Solorio}]{mihalcea2024aiweirdwayai}
Rada Mihalcea, Oana Ignat, Longju Bai, Angana Borah, Luis Chiruzzo, Zhijing Jin, Claude Kwizera, Joan Nwatu, Soujanya Poria, and Thamar Solorio. 2024.
\newblock \href {https://arxiv.org/abs/2410.16315} {Why {AI} is {WEIRD} and should not be this way: {T}owards {AI} for everyone, with everyone, by everyone}.
\newblock \emph{Preprint}, arXiv:2410.16315.
\bibitem[{Mousi et~al.(2025)Mousi, Durrani, Ahmad, Hasan, Hasanain, Kabbani, Dalvi, Chowdhury, and Alam}]{mousi-etal-2025-aradice}
Basel Mousi, Nadir Durrani, Fatema Ahmad, Md.~Arid Hasan, Maram Hasanain, Tameem Kabbani, Fahim Dalvi, Shammur~Absar Chowdhury, and Firoj Alam. 2025.
\newblock \href {https://aclanthology.org/2025.coling-main.283/} {{A}ra{D}i{CE}: Benchmarks for dialectal and cultural capabilities in {LLM}s}.
\newblock In \emph{Proceedings of the 31st International Conference on Computational Linguistics}, pages 4186--4218, Abu Dhabi, UAE. Association for Computational Linguistics.
\bibitem[{Mubarak et~al.(2017)Mubarak, Darwish, and Magdy}]{mubarak-etal-2017-abusive}
Hamdy Mubarak, Kareem Darwish, and Walid Magdy. 2017.
\newblock \href {https://doi.org/10.18653/v1/W17-3008} {Abusive language detection on {A}rabic social media}.
\newblock In \emph{Proceedings of the First Workshop on Abusive Language Online}, pages 52--56, Vancouver, BC, Canada. Association for Computational Linguistics.
\bibitem[{Myung et~al.(2024)Myung, Lee, Zhou, Jin, Putri, Antypas, Borkakoty, Kim, Perez-Almendros, Ayele, Gutierrez~Basulto, Ibanez-Garcia, Lee, Muhammad, Park, Rzayev, White, Yimam, Pilehvar, Ousidhoum, Camacho-Collados, and Oh}]{myung2024blendbenchmarkllmseveryday}
Junho Myung, Nayeon Lee, Yi~Zhou, Jiho Jin, Rifki Putri, Dimosthenis Antypas, Hsuvas Borkakoty, Eunsu Kim, Carla Perez-Almendros, Abinew~Ali Ayele, Victor Gutierrez~Basulto, Yazmin Ibanez-Garcia, Hwaran Lee, Shamsuddeen~H Muhammad, Kiwoong Park, Anar Rzayev, Nina White, Seid~Muhie Yimam, Mohammad~Taher Pilehvar, Nedjma Ousidhoum, Jose Camacho-Collados, and Alice Oh. 2024.
\newblock \href {https://proceedings.neurips.cc/paper_files/paper/2024/file/8eb88844dafefa92a26aaec9f3acad93-Paper-Datasets_and_Benchmarks_Track.pdf} {{BLEnD}: A benchmark for llms on everyday knowledge in diverse cultures and languages}.
\newblock In \emph{Advances in Neural Information Processing Systems}, volume~37, pages 78104--78146. Curran Associates, Inc.
\bibitem[{Naous et~al.(2024)Naous, Ryan, Ritter, and Xu}]{naous-etal-2024-beer}
Tarek Naous, Michael~J Ryan, Alan Ritter, and Wei Xu. 2024.
\newblock \href {https://doi.org/10.18653/v1/2024.acl-long.862} {Having beer after prayer? measuring cultural bias in large language models}.
\newblock In \emph{Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)}, pages 16366--16393, Bangkok, Thailand. Association for Computational Linguistics.
\bibitem[{Ousidhoum et~al.(2019)Ousidhoum, Lin, Zhang, Song, and Yeung}]{ousidhoum-etal-2019-multilingual}
Nedjma Ousidhoum, Zizheng Lin, Hongming Zhang, Yangqiu Song, and Dit-Yan Yeung. 2019.
\newblock \href {https://doi.org/10.18653/v1/D19-1474} {Multilingual and multi-aspect hate speech analysis}.
\newblock In \emph{Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)}, pages 4675--4684, Hong Kong, China. Association for Computational Linguistics.
\bibitem[{Romero et~al.(2024)Romero, Lyu, Wibowo, G\'{o}ngora, Mandal, Purkayastha, Ortiz-Barajas, Cueva, Baek, Jeong, Hamed, Zheng-Xin, Lim, Silva, Dunstan, Jouitteau, LE~MEUR, Nwatu, Batnasan, Otgonbold, Gochoo, Ivetta, Benotti, Alonso~Alemany, Maina, Geng, Timponi~Torrent, Belcavello, Viridiano, Cruz, Velasco, Ignat, Burzo, Whitehouse, Abzaliev, Clifford, Caulfield, Lynn, Salamea-Palacios, Araujo, Kementchedjhieva, Mihaylov, Azime, Ademtew, Balcha, Etori, Adelani, Mihalcea, Tonja, Cabrera, Vallejo, Lovenia, Zhang, Estecha-Garitagoitia, Rodr\'{\i}guez-Cantelar, Ehsan, Chevi, Adilazuarda, Diandaru, Cahyawijaya, Koto, Kuribayashi, Song, Khandavally, Jayakumar, Dabre, Imam, Nagasinghe, Dragonetti, D'Haro, Olivier, Gala, Chitale, Farooqui, Solorio, and Aji}]{romero2024cvqa}
David Romero, Chenyang Lyu, Haryo Wibowo, Santiago G\'{o}ngora, Aishik Mandal, Sukannya Purkayastha, Jesus-German Ortiz-Barajas, Emilio Cueva, Jinheon Baek, Soyeong Jeong, Injy Hamed, Yong Zheng-Xin, Zheng~Wei Lim, Paula Silva, Jocelyn Dunstan, M\'{e}lanie Jouitteau, David LE~MEUR, Joan Nwatu, Ganzorig Batnasan, Munkh-Erdene Otgonbold, Munkhjargal Gochoo, Guido Ivetta, Luciana Benotti, Laura Alonso~Alemany, Hern\'{a}n Maina, Jiahui Geng, Tiago Timponi~Torrent, Frederico Belcavello, Marcelo Viridiano, Jan Christian~Blaise Cruz, Dan~John Velasco, Oana Ignat, Zara Burzo, Chenxi Whitehouse, Artem Abzaliev, Teresa Clifford, Gr\'{a}inne Caulfield, Teresa Lynn, Christian Salamea-Palacios, Vladimir Araujo, Yova Kementchedjhieva, Mihail Mihaylov, Israel Azime, Henok Ademtew, Bontu Balcha, Naome~A. Etori, David Adelani, Rada Mihalcea, Atnafu~Lambebo Tonja, Maria Cabrera, Gisela Vallejo, Holy Lovenia, Ruochen Zhang, Marcos Estecha-Garitagoitia, Mario Rodr\'{\i}guez-Cantelar, Toqeer Ehsan, Rendi Chevi, Muhammad
Adilazuarda, Ryandito Diandaru, Samuel Cahyawijaya, Fajri Koto, Tatsuki Kuribayashi, Haiyue Song, Aditya Khandavally, Thanmay Jayakumar, Raj Dabre, Mohamed Imam, Kumaranage Nagasinghe, Alina Dragonetti, Luis~Fernando D'Haro, Niyomugisha Olivier, Jay Gala, Pranjal Chitale, Fauzan Farooqui, Thamar Solorio, and Alham Aji. 2024.
\newblock \href {https://proceedings.neurips.cc/paper_files/paper/2024/file/1568882ba1a50316e87852542523739c-Paper-Datasets_and_Benchmarks_Track.pdf} {{CVQA}: Culturally-diverse multilingual visual question answering benchmark}.
\newblock In \emph{Advances in Neural Information Processing Systems}, volume~37, pages 11479--11505. Curran Associates, Inc.
\bibitem[{Ryan et~al.(2024)Ryan, Held, and Yang}]{ryan-etal-2024-unintended}
Michael~J Ryan, William Held, and Diyi Yang. 2024.
\newblock \href {https://doi.org/10.18653/v1/2024.acl-long.853} {Unintended impacts of {LLM} alignment on global representation}.
\newblock In \emph{Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)}, pages 16121--16140, Bangkok, Thailand. Association for Computational Linguistics.
\bibitem[{Sapir(1929)}]{2598291a-d0b6-399c-a4fa-1f25e75dadc3}
E.~Sapir. 1929.
\newblock \href {http://www.jstor.org/stable/409588} {The status of linguistics as a science}.
\newblock \emph{Language}, 5(4):207--214.
\bibitem[{Sawaf et~al.(2023)Sawaf, El-Beltagy, Zaghouani, Magdy, Abdelali, Tomeh, Abu~Farha, Habash, Khalifa, Keleg, Haddad, Zitouni, Mrini, and Almatham}]{arabicnlp-ws-2023-arabicnlp}
Hassan Sawaf, Samhaa El-Beltagy, Wajdi Zaghouani, Walid Magdy, Ahmed Abdelali, Nadi Tomeh, Ibrahim Abu~Farha, Nizar Habash, Salam Khalifa, Amr Keleg, Hatem Haddad, Imed Zitouni, Khalil Mrini, and Rawan Almatham, editors. 2023.
\newblock \href {https://aclanthology.org/2023.arabicnlp-1.0/} {\emph{Proceedings of ArabicNLP 2023}}. Association for Computational Linguistics, Singapore (Hybrid).
\bibitem[{Sengupta et~al.(2023)Sengupta, Sahu, Jia, Katipomu, Li, Koto, Marshall, Gosal, Liu, Chen, Afzal, Kamboj, Pandit, Pal, Pradhan, Mujahid, Baali, Han, Bsharat, Aji, Shen, Liu, Vassilieva, Hestness, Hock, Feldman, Lee, Jackson, Ren, Nakov, Baldwin, and Xing}]{sengupta2023jaisjaischatarabiccentricfoundation}
Neha Sengupta, Sunil~Kumar Sahu, Bokang Jia, Satheesh Katipomu, Haonan Li, Fajri Koto, William Marshall, Gurpreet Gosal, Cynthia Liu, Zhiming Chen, Osama~Mohammed Afzal, Samta Kamboj, Onkar Pandit, Rahul Pal, Lalit Pradhan, Zain~Muhammad Mujahid, Massa Baali, Xudong Han, Sondos~Mahmoud Bsharat, Alham~Fikri Aji, Zhiqiang Shen, Zhengzhong Liu, Natalia Vassilieva, Joel Hestness, Andy Hock, Andrew Feldman, Jonathan Lee, Andrew Jackson, Hector~Xuguang Ren, Preslav Nakov, Timothy Baldwin, and Eric Xing. 2023.
\newblock \href {https://arxiv.org/abs/2308.16149} {Jais and {Jais-chat}: {A}rabic-centric foundation and instruction-tuned open generative large language models}.
\newblock \emph{Preprint}, arXiv:2308.16149.
\bibitem[{Shahid and Vashistha(2023)}]{10.1145/3544548.3581538}
Farhana Shahid and Aditya Vashistha. 2023.
\newblock \href {https://doi.org/10.1145/3544548.3581538} {Decolonizing content moderation: Does uniform global community standard resemble utopian equality or western power hegemony?}
\newblock In \emph{Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems}, CHI '23, New York, NY, USA. Association for Computing Machinery.
\bibitem[{Shang et~al.(2024)Shang, Abdine, Khoubrane, Mohamed, Abbahaddou, Ennadir, Momayiz, Ren, Moulines, Nakov, Vazirgiannis, and Xing}]{shang2024atlas}
Guokan Shang, Hadi Abdine, Yousef Khoubrane, Amr Mohamed, Yassine Abbahaddou, Sofiane Ennadir, Imane Momayiz, Xuguang Ren, Eric Moulines, Preslav Nakov, Michalis Vazirgiannis, and Eric Xing. 2024.
\newblock \href {https://arxiv.org/abs/2409.17912} {Atlas-{C}hat: Adapting large language models for low-resource {M}oroccan {A}rabic dialect}.
\newblock \emph{Preprint}, arXiv:2409.17912.
\bibitem[{Singh et~al.(2024)Singh, Romanou, Fourrier, Adelani, Ngui, Vila-Suero, Limkonchotiwat, Marchisio, Leong, Susanto, Ng, Longpre, Ko, Smith, Bosselut, Oh, Martins, Choshen, Ippolito, Ferrante, Fadaee, Ermis, and Hooker}]{singh2024globalmmluunderstandingaddressing}
Shivalika Singh, Angelika Romanou, Clémentine Fourrier, David~I. Adelani, Jian~Gang Ngui, Daniel Vila-Suero, Peerat Limkonchotiwat, Kelly Marchisio, Wei~Qi Leong, Yosephine Susanto, Raymond Ng, Shayne Longpre, Wei-Yin Ko, Madeline Smith, Antoine Bosselut, Alice Oh, Andre F.~T. Martins, Leshem Choshen, Daphne Ippolito, Enzo Ferrante, Marzieh Fadaee, Beyza Ermis, and Sara Hooker. 2024.
\newblock \href {https://arxiv.org/abs/2412.03304} {Global {MMLU}: Understanding and addressing cultural and linguistic biases in multilingual evaluation}.
\newblock \emph{Preprint}, arXiv:2412.03304.
\bibitem[{Wang et~al.(2024)Wang, Jiao, Huang, Dai, Huang, Tu, and Lyu}]{wang-etal-2024-countries}
Wenxuan Wang, Wenxiang Jiao, Jingyuan Huang, Ruyi Dai, Jen-tse Huang, Zhaopeng Tu, and Michael Lyu. 2024.
\newblock \href {https://doi.org/10.18653/v1/2024.acl-long.345} {Not all countries celebrate thanksgiving: On the cultural dominance in large language models}.
\newblock In \emph{Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)}, pages 6349--6384, Bangkok, Thailand. Association for Computational Linguistics.
\bibitem[{Zitouni et~al.(2020)Zitouni, Abdul-Mageed, Bouamor, Bougares, El-Haj, Tomeh, and Zaghouani}]{wanlp-2020-arabic}
Imed Zitouni, Muhammad Abdul-Mageed, Houda Bouamor, Fethi Bougares, Mahmoud El-Haj, Nadi Tomeh, and Wajdi Zaghouani, editors. 2020.
\newblock \href {https://aclanthology.org/2020.wanlp-1.0/} {\emph{Proceedings of the Fifth Arabic Natural Language Processing Workshop}}. Association for Computational Linguistics, Barcelona, Spain (Online).
\end{thebibliography}