A group of engineers, researchers and a Silicon Valley-based chip company collaborated to release advanced Arabic-language software that could power generative ai Application.

The new large language model, called Jais, consisting of 13 billion parameters was created from a large batch of data combining Arabic and English, part of which is from computer code. The group, which included academics and engineers, started the project partly because they noted that there are few large language models that are bilingual.

The new language model was created with the help of supercomputers built by Silicon Valley-based Cerebras Systems, which designs chips the size of dinner plates that compete with Nvidia’s Powerful AI Hardware. Nvidia’s chips are in short supply, which has prompted companies around the world to seek alternatives.

Named after the highest peak in the United Arab Emirates, Jace Cerebrus is a collaboration between the Mohamed bin Zayed University of Artificial Intelligence and Inception, a subsidiary of Abu Dhabi-based tech group G42, which focuses on AI.

According to Professor Timothy Baldwin of the Mohamed bin Zayed University of Artificial Intelligence, because there is not enough Arabic data to train a model the size of Jace, computer code within the English language data helped train the model’s ability to reason. of.

“(The code) gives the model a big head start in terms of reasoning capabilities, because it explains the (logical) steps,” Baldwin told Reuters.

Jayce will be available through an open source license.

The group trained the JAS model on a Cerebras supercomputer called the Condor Galaxy. This year Cerebras announced It had sold three such units to the G42, the first of which was due to arrive this year and the remaining units to be delivered in 2024.