Spaces:

---

inria-chile

/

llaca-datathon

Like 1

Running

Dear Hugging Face,

We at Inria Chile are organizing a regional datathon on local knowledge evaluation of LLMs the upcoming October 3, 2026.

Request

We would like to request your support for:

• Hosting the datathon app that we have coded as a Gradio space (https://huggingface.co/spaces/inria-chile/llaca-datathon) in a higher tier CPU to support the load of participants during the day of the event.
• Model inference end-point credits to support the a frequent evaluation of the teams to prove them with an engaging process feedback. Alternatively we could also use the models in the Gradio app if GPU credits are provided.

We are more than happy to have you involved in more ways, give a talk, etc.

About the datathon

• Goal: Create a crowd-sourced QA dataset of regional Latin American cultural knowledge. This dataset can then be used to evaluate how well different LLMs represent this knowledge.
• Dynamics: (in summarized form)
  • 100% online one day event.
  • Universities in Latin America sign-up to take part of the datathon. As of Sept 23, 2026 we have 11 universities. List is updated in https://datathonregional.inria.cl/evento/.
  • Each university enrolls one or more team.
  • Each team contributes with a set of questions.
  • Teams are scored by a panel of (open) LLMs by how much they are able to confuse the panel with their questions.
  • The team with the best score wins a prize of 2000 euros.
• More info:
  • Web: https://datathonregional.inria.cl
  • Note in Inria Chile: https://inria.cl/es/inscripciones-abiertas-para-participar-de-la-datathon-regional-evaluacion-socio-cultural-de-los
• LinkedIn: https://lnkd.in/p/d9FWHDpy
• Instagram: https://www.instagram.com/p/Ddjb66OkTav/?img_index=1

Context of the project

This is a part of Inria Chile project LLACA (LLM assimilation of cultural aspects).

A first version of this research was published as:

• Paper: Yannis Karmim, Renato Pino, Hernan Contreras, Hernan Lira, Sebastian Cifuentes, et al.. Leveraging Wikidata for Geographically Informed Sociocultural Bias Dataset Creation: Application to Latin America. Workshop on Multilingual and Multicultural Evaluation (MME) of the 19th Conference of the European Chapter of the Association for Computational Linguistics (EACL), Pinzhen Chen; Vilém Zouhar; Hanxu Hu; Simran Khanuja; Wenhao Zhu; Barry Haddow; Alexandra Birch; Alham Fikri Aji; Rico Sennrich; Sara Hooker, Mar 2026, Rabbat, Morocco. https://inria.hal.science/hal-05510068v1
• Github: https://github.com/Inria-Chile/LatamQA
• Hugging Face: https://huggingface.co/collections/inria-chile/latamqa

About Inria Chile

Created in 2012, Inria Chile is the first Inria center outside France. It is a driving force for technological innovation and knowledge transfer, collaborating effectively with companies, universities, public institutions, and startups to meet the challenges of the digital revolution. It aims to inspire and educate future generations of scientists and engineers to take the lead in this transformation. It is also a means to promote the R&D activities of companies and startups in Chile and Latin America.