ֱ

Training an Arabic LLM that reflects local values

Training an Arabic LLM that reflects local values

Training an Arabic LLM that reflects local values
The Arab world did not play a key role in the PC, internet and mobile eras. In the AI era, it will be different. (Shutterstock)
Short Url

Advances in the large language models that underpin generative AI are changing everything, from medicine and education to entertainment.

Our relationship with technology is becoming more intimate as machines change from passive tools into active assistants that amplify our innate human abilities.

This new era poses both a challenge and an opportunity for the Middle East.

The challenge is that leaders in this new field, like OpenAI’s ChatGPT and Google’s Gemini, come from Silicon Valley, or from China, where my team at 01.AI has built models that rival the Americans. In Europe, too, startups such as France’s Mistral have entered the race.

The opportunity is for the Middle East to join this league and make sure its voice is heard.

Inspired by my latest trip to Riyadh, I decided to test how the current crop of AI models would handle a simple request. I imagined myself as a young Saudi getting ready to host a dinner party and asked ChatGPT to prepare a menu.

The food it recommended sounded delicious — stuffed grape leaves, tabouleh salad, mandi and stuffed dates. But the beverages were a problem.

Aside from drinks such as mint lemonade and jallab, a mixture of dates, grape molasses and rose water, ChatGPT also offered this: “For alcoholic beverages, you could offer a selection of international wines, beers, or non-alcoholic mocktails.”

To its credit, when I repeated the question, it offered only non-alcoholic drinks.

If a model recommends breaking both the law and cultural norms, imagine how it might answer other more sensitive questions about politics or religion? Indeed, researchers have even shown that some models have exhibited an anti-Muslim bias.

My modest test underlines the urgent need to develop an Arabic large language model that reflects local values.

The first step to building this is creating enough high-quality Arabic digitized data to properly train a new generation of models.

Although there are 400 million Arabic speakers, only an estimated 2 percent of online content is in Arabic. Meta’s open source LLM model Llama is overwhelmingly trained on English data, with Arabic comprising less than 0.1 percent of the data.

The lack of data naturally skews the results. To fix this dearth of data, either a visionary entrepreneur or a government-backed organization should collect, digitize and convert the many Arabic books into training data for Arabic models.

Once the data is gathered, it can be fed into the breakthrough pre-training process, which reads trillions of words and creates its own virtual concept space or model of the world. This concept space has been shown to be mostly in English and Chinese.

Adding a sizable number of texts in Arabic, which has enormous cultural output and significance, will make the concept space more knowledgeable about Arabic and more balanced in its concepts and views.

After such pre-training, the model needs to be fine-tuned by data and labels from the Arab world, which will align with the values of the region. Those are different from American models, which are aligned to US values, and Chinese models, which reflect Chinese values.

The collection of alignment data, the coordination of human labeling and the alignment process will need to be done in-region by AI experts.

A new Arabic-enhanced large language model could encourage entrepreneurs and developers to build new applications tailored to the needs of their nations.

Kai-fu Lee

Finally, safety modules will need to be added to ensure legal compliance and to avoid harm. These will also need to be developed locally.

The above steps will create localized, sovereign models that will reflect the traditions of the Middle East. Privately developed or government-backed, it could be the foundation for a new wave of Arabic AI innovation.

A new Arabic-enhanced large language model could encourage entrepreneurs and developers to build new applications tailored to the needs of their nations.

Imagine an AI tool that could find, summarize, organize and write insightful content, an AI teacher that makes learning fun and customized, an AI doctor that is more knowledgeable than any human, an AI engineer that can write software and applications, and an AI assistant that knows its owner better than the owner themselves.

The Arab world did not play a leading role in the PC, internet and mobile eras. In the AI era, it will be different.

This transformation is by no means an easy feat. It will require an unprecedented investment of money, energy and human capital.

Middle Eastern leaders like Saudi Crown Prince Mohammed bin Salman and others have shown that they have the vision, determination and resources to lead their countries into the future.

Standing on my hotel balcony in Jeddah recently, overlooking the King Abdullah University of Science and Technology, I saw part of that vision coming to fruition.

Universities such as KAUST and the Mohamed bin Zayed University of Artificial Intelligence in the UAE are striking examples of the resources that have already been poured into this transformation.

These world-class academic institutions can attract and retain the best top tier global talent.  It is especially important to bring in the world’s best computer engineers to help fulfill this vision of the future AI.

Our team at 01.AI has shown what a group of talented and motivated computer scientists can achieve in just one year. With the right commitment of resources and drawing upon the best talent, countries like ֱ can easily catch up with their global peers.

The Middle East can also lead the world in the use of renewables to run power-hungry generative AI models.

As it seeks to diversify its economy, ֱ is actively promoting the use of alternative energy sources such as solar, which could power server farms and reduce their carbon footprint — a growing concern as AI becomes more widespread.

It may take time for countries to figure out their strategy for building a sovereign AI. But it is critical for the Arab world to quickly catalyze the creation of culturally appropriate LLMs and build a rich ecosystem to allow AI-powered Arabic apps to blossom.

A recent encounter with a female sales assistant at a computer store in Riyadh served as an apt reminder of what is at stake. Dressed in jeans and sporting a tattoo, she was a reminder of the transformative changes that the country is undergoing.

Where are you from, I asked. “I’m Saudi,” she said. “One day I want to be ֱ’s Elon Musk.” I hope on my next visit she will pitch me a homegrown AI app.

Kai-Fu Lee is a computer scientist, CEO of 01.AI, chairman of Sinovation Ventures, former president of Google China, and author of “AI 2041” and “AI Superpowers”
 

Disclaimer: Views expressed by writers in this section are their own and do not necessarily reflect Arab News' point of view

India’s commerce minister heads to UK to fast-track free trade deal

India’s commerce minister heads to UK to fast-track free trade deal
Updated 3 min 36 sec ago

India’s commerce minister heads to UK to fast-track free trade deal

India’s commerce minister heads to UK to fast-track free trade deal
  • FTA talks started in 2022 and stalled over tariffs, mobility for services professionals
  • Deal-in-principle was announced by Indian, British PMs last month

New Delhi

India’s Commerce Minister Piyush Goyal has embarked on a two-day visit to the UK to accelerate talks on a long-pending bilateral free trade agreement, his office said on Wednesday.

Launched in January 2022, the FTA negotiations between India and the UK were set to conclude the same year, but despite more than a dozen formal rounds, talks have stalled over issues like tariffs, rules of origin and mobility for services professionals.

A deal-in-principle was announced in May by Indian Prime Minister Narendra Modi and his British counterpart, Keir Starmer.

Goyal’s UK visit comes in the “backdrop of the announcement” and “aims to accelerate bilateral engagements and harness emerging opportunities,” the Ministry of Commerce and Industry said in a statement.

The minister is scheduled to meet UK Business and Trade Secretary Jonathan Reynolds to “review the progress made in the ongoing FTA negotiations and chart out a clear, time-bound road map for its finalization and implementation.”

If Goyal’s visit succeeds in producing an implementation road map with timelines, he would be able to start negotiations on a bilateral investment treaty with the UK, Anupam Manur, professor of economics at the Takshashila Institution in Bangalore, told Arab News.

“A working FTA for India is extremely important, especially in a scenario where global trade uncertainty is at an all-time high due to the trade war and tariffs imposed by President Trump,” Manur said.

“In this scenario, an FTA with the UK delivers greater certainty to India, provides market access to an important large economy, and will also act as a leverage point for trade negotiations with the US.”

India has so far signed 14 free trade agreements with 25 countries, along with several regional and preferential trade pacts covering additional nations. These include agreements with the Association of Southeast Asian Nations, Japan, South Korea, Australia and the UAE.

Talks are also ongoing with the Gulf Cooperation Council and the EU — with commitments to conclude talks in 2025.


UK police slammed for not arresting US diplomat’s wife in fatal crash

UK police slammed for not arresting US diplomat’s wife in fatal crash
Updated 6 min 52 sec ago

UK police slammed for not arresting US diplomat’s wife in fatal crash

UK police slammed for not arresting US diplomat’s wife in fatal crash
  • Anne Sacoolas, who was driving on the wrong side of the road outside the US military base at RAF Croughton in Northamptonshire, killed teenager Harry Dunn

LONDON: An independent review in Britain criticized police on Wednesday for failing to arrest a US diplomat’s wife after she killed a British teenager in a car accident before fleeing the country in 2019.

The accident in which Harry Dunn, 19, died became a diplomatic issue between the UK and United States, leading to his family meeting US President Donald Trump at the White House.

Anne Sacoolas, who was driving on the wrong side of the road outside the US military base at RAF Croughton in Northamptonshire, claimed in the ensuing days to have diplomatic immunity.

Sacoolas, whose husband was an intelligence official and has herself been reported to have been a CIA operative, left Britain soon after hitting Dunn on his motorbike in the August 2019 accident.

The review, commissioned by Northamptonshire’s chief constable, Ivan Balhatchet, said the decision not to arrest her was partly based on “information received that Anne Sacoolas was in shock.”

“While the welfare of any person is a concern for officers, this should not have prevented the arrest of Anne Sacoolas,” it said.

The review said officers made the decision believing Dunn’s injuries to be survivable and that had this not been the case they would have made an arrest.

But it found that after his death there was no further discussion documented of whether Sacoolas should be detained.

“The review has potentially highlighted a culture of not arresting... which could lead to evidence not being obtained and influencing a charging decision or a sentence on conviction,” it said.

The review also criticized the Northamptonshire force’s former chief Nick Adderley.

After relations with Dunn’s family broke down there were “multiple areas of direct involvement from CC (Chief Constable) Adderley which had a detrimental impact” on the senior investigating officer and their team as they tried to “rebuild trust,” it added.

After her return to the United States, Sacoolas refused to go back to the UK to face court proceedings.

She eventually pleaded guilty to causing death by careless driving via video link from the US to a London court.

She was handed an eight-month prison sentence in December 2022, suspended for 12 months, meaning she would not serve jail time unless she committed another offense in that time.

Reacting to the review, Dunn’s mother Charlotte Charles said it “confirms what we have known for years — that we were failed by the very people we should have been able to trust.”

“Harry was left to die on the roadside. Sacoolas was not arrested, even though the police had every power to do so,” she said.


Toronto Arab Film Festival showcases diverse selection this June

Toronto Arab Film Festival showcases diverse selection this June
Updated 52 min 7 sec ago

Toronto Arab Film Festival showcases diverse selection this June

Toronto Arab Film Festival showcases diverse selection this June

DUBAI: The Toronto Arab Film Festival returns for its sixth annual edition with a diverse lineup from June 20 to 29.

“This year, we are screening over 50 films — both features and shorts — which is our largest number to date … it’s fulfilling to watch the development of the Canadian-Arab film industry in real time,” Rolla Tahir, a Sudanese filmmaker and co-founder of TAF, said.

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

This year’s program reflects the growing diversity and creative evolution of Arab cinema, with some well-known filmmakers participating.

“We’re seeing a notable rise in genre films, especially horror and sci-fi. For example, there’s a horror film from Tunisia and a short program dedicated entirely to sci-fi and horror,” Tahir said.

Participants this year include Lebanese filmmaker Mira Shabib with her film “Arze’” and “Back to Alexandria” by Tamer Ruggli starring Lebanese actress Nadine Labaki.

TAF has also become a valuable platform for professional development, offering networking opportunities for both emerging and established talent.

“This year, we’re introducing an informal industry meet-and-greet — a casual networking event with no structured pitches,” Tahir explained.

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

The event is designed to create a relaxed environment where Arab filmmakers can connect with industry professionals, ask candid questions, and introduce their projects without the pressure of formal presentations.

The festival’s mission may seem simple — to raise awareness of Arab cinema among Canadian audiences — but achieving that impact requires a deliberate strategy.

It is one that Tahir and her co-founders have refined over the years.

“Each year, we collaborate with other festivals to co-present films and expand outreach beyond Arab audiences,” she said.

For Tahir, the appeal of Arab cinema to non-Arab audiences comes naturally, thanks to the enduring quality and resilience of the work itself.

“What stands out is perseverance. Regardless of what’s happening in our countries or personal lives, Arab filmmakers continue telling their stories.”

It is that very perseverance — expressed through everything from harrowing documentaries to satirical comedies — that gives Arab filmmakers their distinct voice.

“I want people to know we’re still making films — and that we’re making different, bold, and innovative ones,” Tahir said.


Smartphones banned from schools in Afghan Taliban’s heartland

Smartphones banned from schools in Afghan Taliban’s heartland
Updated 56 min 5 sec ago

Smartphones banned from schools in Afghan Taliban’s heartland

Smartphones banned from schools in Afghan Taliban’s heartland
  • A ban on smartphones in schools issued by Taliban authorities in southern Afghanistan came into force, students and teachers confirmed to AFP on Wednesday, over concerns of “focus” and “Islamic law“

AFGHANISTAN: A ban on smartphones in schools issued by Taliban authorities in southern Afghanistan came into force, students and teachers confirmed to AFP on Wednesday, over concerns of “focus” and “Islamic law.”
The directive by the provincial Education Department in Kandahar applies to students, teachers and administrative staff in schools and religious schools.
“This decision has been made to ensure educational discipline, focus,” the statement said, adding that it was taken from a “sharia perspective” and that smartphones contribute to “the destruction of the future generation.”
The policy, which has already taken effect in schools across the province, has divided opinion among teachers and students.
“We did not bring smart phones with us to school today,” Saeed Ahmad, a 22-year-old teacher, told AFP.
“I think this is a good decision so that there is more focus on studies,” he added.
Mohammad Anwar, an 11th grader, said “the teachers are saying if anyone is seen bringing a phone, they will start searching the students.”
Another 12th-grade student, refusing to give his name, said the ban would hinder learning in a country where girls are barred from secondary school and university as part of restrictions the UN has dubbed “gender apartheid.”
“When the teacher writes a lesson on the board, I often take a picture so I could write it down later. Now I can’t. This decision will negatively affect our studies.”


The ban has also taken root in religious schools known as madrassas.
“Now there’s a complete ban. No one brings smartphones anymore,” Mohammad, 19 years old madrassa student said.
A number of countries have in recent years moved to restrict mobile phones from classrooms such as France, Denmark and Brazil.
The Taliban authorities have already introduced a ban on images of living beings in media, with multiple provinces announcing restrictions and some Taliban officials refusing to be photographed or filmed.
The Taliban’s Supreme Leader Hibatullah Akhundzada called last week on officials and scholars to reduce their use of smartphones.
“This is the order of the leaders, and we must accept it,” a 28-year-old security forces member told AFP without giving his name as he was not authorized to speak to the media.
“I have now found a brick phone ... I used WhatsApp on my smartphone sometimes, but now I don’t use it anymore,” he added.
Some Taliban officials in Kandahar have started sharing their numbers for brick phones and switching off online messaging apps.


Hosts England face Sri Lanka in 2026 Women’s T20 World Cup opener

Hosts England face Sri Lanka in 2026 Women’s T20 World Cup opener
Updated 18 June 2025

Hosts England face Sri Lanka in 2026 Women’s T20 World Cup opener

Hosts England face Sri Lanka in 2026 Women’s T20 World Cup opener
  • Edgbaston will also host a clash between Asian rivals India and Pakistan on June 14
  • Group 1 includes record six-times champions Australia, South Africa, India, Pakistan

Hosts England will kick off their 2026 Women’s T20 World Cup campaign against Sri Lanka at Edgbaston on June 12 while holders New Zealand begin their title defense against the West Indies a day later, the International Cricket Council said on Wednesday.

Group 1 includes record six-times champions Australia, two-times runners-up South Africa, 2020 finalists India and Pakistan, as well as two teams from the Global Qualifier tournament.

New Zealand, 2009 champions England, Sri Lanka, 2016 winners West Indies and the other two teams from the Global Qualifier are in Group 2.

The top two teams from Group 1 and Group 2 will advance to the semifinals of the biennial T20 international tournament, which will be contested by 12 teams for the first time.

“World Cups are always special, but this one already feels different – it has the potential to be truly game-changing,” England captain Nat Sciver-Brunt said in a statement.

“Playing on home soil, for the biggest prize, against the best players in the world, it’s going to be unmissable. I can’t wait to be a part of it.”

Edgbaston will also host a clash between Asian rivals India and Pakistan on June 14.

Hampshire Bowl, Headingley, Old Trafford, The Oval, Bristol County Ground and Lord’s are the other venues.

The final will take place at Lord’s on July 5.