Thursday, November 7, 2024
HomeTechnologyJapan team develops AI Foundation with Fugaku Supercomputer

Japan team develops AI Foundation with Fugaku Supercomputer

Tokyo (Jiji Press) โ€“ A team of researchers from the Tokyo Institute of Technology, Fujitsu Ltd. and others said Friday that they have developed a large language model that could serve as a basis for generative artificial intelligence, using the Japanese supercomputer Fugaku.

The Fugaku-LLM model has been extensively trained on Japanese-language data, which accounts for 60 percent of the total training data, and is expected to lead to generative AI research tailored to domestic needs.

The researchers, including those from Tohoku University, Nagoya University, the government-backed research institute Riken, CyberAgent Inc. and Kotoba Technologies Inc., launched the project in May 2023 using the supercomputer jointly developed by Fujitsu and Riken.

Fugaku-LLM’s high Japanese language skills can be demonstrated when it fluently answers questions about poems by haiku master Matsuo Basho, they said.

Unlike most other models with Japanese language capabilities, which use continuous learning, Fugaku-LLM is trained from scratch using the team’s own data that does not contain malicious data, so the entire learning process can be understood, they said she, adding that it is superior in terms of transparency and security.

It is also significant that the team successfully trained a large language model with Fugaku, which does not use graphics processing units, but central processing units.

In language model training, it is common to use GPUs. But now they are in short supply due to a fierce global development race for language models.

Fugaku’s computing power was improved by optimizing its communications performance, the researchers said.

โ€œWe have proven our ability to overcome the challenges of Fugaku,โ€ said TIT Prof. Rio Yokota at a press conference. โ€œWe have not been dependent on foreign products at all, which is a great achievement,โ€ Yokota continued.

Fugaku-LLM’s source code was immediately made public. It is also available on Fujitsu’s website.

RELATED ARTICLES

LEAVE A REPLY

Please enter your comment!
Please enter your name here

- Advertisment -
Google search engine

Most Popular

Recent Comments

Translate ยป